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ABSTRACT 


The Department of Defense Information Technology budget stands at nine billion 
dollars and is under severe scrutiny while the backlog of required software continues to grow. 
It is thereby necessary to improve the efficiency of managing the software process. This 
thesis uses the Systems Dynamic Model of Software Project Management to investigate the 
effects of stated goals and project feedback on project manager behavior. Specifically, the 
experiment focuses on how software project managers allocate resources in both factual and 
erroneous feedback environments. The effect of goals and feedback on manager performance 
are measured in terms of staffing level decisions, percent of staff allocated to quality 
assurance activities, estimated schedule, estimated programmer productivity, and estimated 


cost. The results show that manager performance is highly sensitive to stated goals. 
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te Oe Ser os 


I. INTRODUCTION 


A. BACKGROUND 

Department of Defense (DOD) software development costs have outstripped 
hardware costs and are continuing to grow. The major factors contributing to this growth 
of software costs are the continuing increase in the size and complexity of software systems 
and an international climate that calls for rapid adaptation to new situations. While at the same 
time, DOD and the Congress have stressed the importance of reducing the cost, time, and 
effort required to build and maintain software systems. Currently, the DOD Information 
Technology budget stands at nine billion and is under severe scrutiny while the backlog of 
required software continues to grow. It is thereby necessary to improve the efficiency of 
managing the software process 

Prior research suggests that programmers are goal driven. In a 1974 paper, 
(Weinberg and Schulman, 1974) showed that programming team performance is highly 
sensitive to given objectives. The paper showed that each team finished best with respect to 
the objective they were asked to optimize. Further research suggests that software managers 
are also highly sensitive to stated goals. In a 1995 paper, (Swett, 1995) demonstrated using 
graduate students in an Information Technology Management curriculum that software 
managers are highly sensitive to goals and perform best in the goals they are given. Two 
Important conclusions have been drawn from this research. First, that managers/programmers 
have very high achievement motivation toward their goals. Second, that different software 
goals are in conflict with each other. 

Recently, the interaction between goals and feedback have been the subject of scrutiny 
by several researchers. Information about ones performance (feedback) has been 
hypothesized to enter into the goal-setting process by serving to evaluate assigned goals to 
both determine goal acceptance and to form personal goals. A study using graduate students 
focused on feedback as a necessary condition for goals to effect performance. It was 
predicted that feedback and goals would interactively relate to performance. Results 


supported the hypothesis by indicating that the individual differences in the self-set goals were 


significantly higher in the feedback group than in the no-feedback group, and that it was in 
the feedback condition that the relationship between goals and performance was significantly 
higher than in the no-feedback condition. Ref. 10 

Research seems to suggest that feedback 1s a necessary condition for goals to effect 
performance, and although there has been past research on the effects of goals on the 
software management process, there has never been a past experiment focused on the 
interaction between feedback and goals to evaluate the performance of the software 


management process. 


B. PURPOSE OF RESEARCH 

The purpose of this thesis is to design, develop, and conduct an experiment using the 
System Dynamics Model (SDM) of Software Project Management developed in Ref. 2 to 
investigate whether managerial goals (i.e. schedule, cost, and quality) and project feedback 
will have a significant influence on managerial behavior and project outcome. Specifically, 
this research will investigate the impact of different schedule, cost, and quality goals on 
managerial decisions under the conditions of both accurate and erroneous feedback in 
allocating staff resources, and whether this leads to significant differences in project 
outcomes. Further, this research will examine the effects of Goal-discrepancy feedback 
(GDF) on project performance. GDF indicates whether subjects were performing above or 
below assigned goals, and by how much. Ref. 9 Even though research has been conducted 
into the affect of goals on software managers, no study on the interaction between feedback | 
and goals on project managers using this type of tool has been published. 
C, SCOPE OF RESEARCH 

The scope of this research is the design, construction, and conduct of an experiment 
using the System Dynamics Model of Software Project Management to analyze the 
interaction between feedback and conflicting goals on software project managers. The 
System Dynamics Model of Software Project Management will be used to simulate the 
programming phase of an actual software project. Graduate students, representing software 


managers, will be divided into four groups and will be asked to make several decisions for 


their project every 40 days throughout the programming phase of the project life cycle. 

The four groups represent different combinations of projects and goal sets and will 
be designated as groups Al, A2, Bl, and B2. The letter will indicate the project to be 
managed. Project A will be have accurate feedback throughout the programming phase. 
Project B will have erroneous feedback over estimating project completion until day 120. 
The number indicates the goal set. Goal set | 1s cost and schedule. Goal set 2 1s quality and 
schedule. 

Data will be collected on several dependent and independent variables after each 40 
day period. This data will then be statistically analyzed to determine differences in decision 
making performance among the groups. The experiment will seek to investigate the following 
research questions: 1. What degree of influence do project feedback and goals have on a 
software project manager's staffing decisions? 2. How will project feedback and goals effect 
project outcome? 

D. LIMITATIONS 

The participants for this experiment were graduate students in their fifth quarter of an 
eight quarter graduate program leading to a MS degree in Information Technology 
Management at the Naval Postgraduate School in Monterey, California.) Although these 
students are not actual software managers, they have received extensive education in software 
design and management. It 1s assumed that these students will perform comparable to 
professional software managers. This assumption is further supported by the findings of 
William Remus. [Ref. 5] 
ie. THESIS ORGANIZATION 

Chapter I] describes the software, and design of the documentation, as well as the 
design considerations taken into account during the creation of the experiment. Chapter II] 
describes the experimental tasks, characteristics, organization, methodology, and experimental 
group. Chapter IV analyses the results. Chapter V summarizes the accomplishments and 


findings and provides suggestions for further research. 
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Il. PREPARATION OF THE EXPERIMENTAL INTERFACE 


A. EXPERIMENTAL DESIGN 

The System Dynamics Model of Project Management enables the conduct of 
controlled software management experiments. Depending on the interface used, the 
model can be used to simulate any or all aspects of a software management project. 
Although the model is capable of simulating any phase of the software development life 
cycle, in this experiment, the system only mimics the development phase of a software 
project. That is, the period from the completion of the design phase to the beginning of 
the testing phase. The player, or subject, plays the role of manager of a software project. 
Prior to starting the game, the subject is given an instruction set that includes a specific 
goal set. 

Two separate project scenarios were constructed to investigate decisions under 
both accurate feedback and erroneous feedback. Project A provided accurate real time 
feedback through out the experiment, while project B provided an overestimation of . 
project completion until day 120 to the subject, and then provided accurate feedback. 
Project B's subjects were shown reports and graphs reflecting that they were further along 
in the project than they actually were. For each project, two goal combinations were used 
for experimental analysis. All combinations contained the element of schedule, for without 
a schedule constraint, dysfunctional behavior would most likely occur. Figure 2-1 1s a 


chart that depicts the goal and project combinations. 






Cost and Schedule Quality and Schedule 
| Projet fp | i] |B 


Figure 2-1 Project/Goal Numbering Scheme 








1. Cost and Schedule Goal Set 

The first goal set is cost and schedule. “Cost and Schedule” was given the number 
11. The identical goal set stated in the reverse order as “Schedule and Cost” is given the 
number 12. For example, goal Al] is stated as “Minimize overruns in both cost and 


schedule.” Goal A1l2 1s stated as *>Minimize overruns in both schedule and cost.” 


2. Quality and Schedule Goal Set 

The second combination is "Quality and Schedule" and is numbered 21. The 
identical goal set stated in the reverse order as "Schedule and Quality" is numbered a 
When this number 1s combined with the specific project the result is a three character 
alphanumeric that denotes the Project, Goal Set, and the Goal Order. For example, B12 
denotes: Project B that has erroneous feedback, Goal set | of Cost and Schedule, and 


Order 2 that changes the ordering of the goal set to Schedule and Cost. 


3. Feedback Treatment 

Figure 2-2 is an example of a completed project A Progress Report Graph. During 
project A, accurate feedback was displayed to the manager about the percent of Delivered 
Source Instructions (DSI) that were complete. The forty-five degree angle line is the 
Planned Percent Completion Rate, which the manager could use to judge if they were 
either ahead or behind schedule by comparing their DSI reported complete to it. In this 
example the manager could tell early in the simulation that they were behind in the project, 


and could make their resource allocation decisions based on that knowledge. 


PLANNED ~ COMPLETION RATE 
% DSI REPORTED COMPLETED 





A. 12—A. 24A. HA. 4RA. 


TIME (DAYS) 
‘jew 1 : Next view _no Print Esc Quit 


Figure 2-2 Accurate Feedback Example 


Figure 2-3 is an example of a completed project B Project Report Graph. During 
Project B, erroneous feedback was displayed to the manager overestimating their projects 


DSI reported complete through day 120. In this example, the project manager was 


unaware until day 120 that his project was significantly behind in completion. Because of 
this, he was much further along in the project when he realized that his critical staffing 
decisions and cost estimates were to low, and he had to begin making major adjustments 


to resource allocations in the middle of the project. 


——- --— PLANNED ~ COMPLETION RATE 
————— _ ~ DSI REPORTED COMPLETED 





A. 127A. 24N. 3A. aR. 
TIME (DAYS) 
Miew 1: Next view_no Print Esc Quit 


Figure 2-3 Erroneous Feedback Example 


4. Experimental Groups 
The experimental population had no previous experience with the SDM model. In 
order to prepare the subjects in running the simulation, each subject received a classroom 


lecture where the interface was demonstrated During this period the subjects were told 


that the experiment was “very real.” For example, they understood that hiring delays. 
turnover, transfers, work force ceilings, and training delays would all affect the actual 
workforce number. After this training session, each subject performed a practice session 
named called the "TOY". Toy was a project that had no specific goal other than to 
familiarize the subject with the experiment. TOY remained constant in size. The purpose 
of the training session was familiarity with the gaming interface and to provide a constant 


level of experience across the experimental groups. 


5. Independent and Dependent Variables 

Each subject made five inputs at each interval throughout the experiment. They 
were the estimated programmer productivity, total workforce requested, the percent of 
this workforce dedicated to quality assurance, the estimated cost to complete the 
programming phase, and the estimated programming phase duration. The ten project 


outcome variables shown in Figure 2-4 were captured at the end of the project simulation. 


Figure 2-4 Project Outcome Variables 













In addition, at each decision point in the simulation (i.e. every 40 days) 31 


variables were automatically captured by the software. A detailed explanation of these 
variable is available in Ref. 7. These variables include the five decisions made by the 
subject plus the process variables on the specific type of report or graph that was viewed 
by the subject and the length of time that the information was presented on the screen. A 


detailed description of these variables in available in Ref. 7. 


B. SOFTWARE AND DOCUMENTATION 

In order to conduct the experiment, three distinct areas of components needed to 
be designed. The software interface for the experiment, the instructions for its use, and 
the questionnaire to be completed at the end of the experiment. Ref 7 provides a detailed 
explanation of how the software actually works. 

1. Documentation 

The documentation was considered critical to the experiment's success. The 
documentation for the experiment was in three parts. The first portion was termed the 
“Instruction Set” and contained the instructions that were specific to each of the eight 
experimental groups. The Instruction Set also contained a documentation page so that 
subjects could record their inputs incase of computer malfunction. Each subject also 
received a copy of the “Description of the Simulation Interface.” This document 
contained general instructions on the meaning of reports and graphs, and how to operate 
the interface, 1.e. view reports and graphs, and was distributed to each subject in their 
envelope at the beginning of both the Toy and Actual experiments. These two documents 
and the accompanying disk were placed in a large manilla envelope for each subject. The 
third part was the Project Questionnaire. The questionnaire was completed by each 


subject at the end of the actual experiment. 
2. Instruction Set 


An example instruction set distributed to the subjects with project/goal/order A] | 


appears as Appendix I. There were a total of nine different sets of instructions created 


10 


One for the practice experiment, and one for each of the eight project/goal/order 


combinations. 


3. Description of the Simulation Interface 

The Description of the Simulation Interface appears as Appendix K. This 
document’s intent was to help the subjects familiarize themselves with the user interface. 
The handout included an example of all of the reports and graphs available to the user 
between project intervals. A short description of the information was also included. This 
information was distributed prior to both the TOY and actual experiments in the manilla 
folder 

4. Project Questionnaire 

Four versions of the Project Questionnaire were developed. An example version 
- of the master appears as Appendix K. Each questionnaire had an X followed by the goal 
set/order combinations. For example X11 referred to either project A or B, goal set 1, 
order 1. X11] or X12 denotes that Question 1 would ask for the percentages concerning 
cost and schedule. X21 or X22 asked for percentages concerning quality and schedule. 
The order of the goal sets was added into the questionnaire to evaluate if goal order and 
demographics effected the experiment. All other questions were identical. The 
questionnaires were not included in the envelope that each subject received prior to 
conducting the experiment, but were retained by the lab attendants and distributed to the 
subjects at project completion. The questionnaires served to gather demographic data on 
the subjects, and to collect feedback concerning the conduct and performance of the 
experiment. 
Cc. INTERFACE VALIDATION 

In order to validate the user interface, pilot experiments were conducted using the 
lab attendants. The pilots were conducted at four separate sittings, allowing time to 
incorporate their suggestions between the sessions. Several improvements were 


implemented concerning clarity and organization of the report and graph screens. 


Ee 


Particular attention was paid to the scaling of the graphs. Every attempt was made not to 
influence subject’s decisions by exaggerated scales on a graph. 
D. FINAL PREPARATIONS 

Having completed the interface design, documentation, and follow-up 
questionnaire, seven copies of each of the eight project disks were made. 15 copies of 
each of the four separate follow-up questionnaires were made. Individual envelopes were 
prepared for each participant and their name written on the outside. Signs were prepared 
and posted on the doors to both labs the evening before both days of experimentation to 


prevent nonparticipants from entering the lab during the conduct of the experiment. 


ie 


IN. CONDUCT OF THE EXPERIMENT 


An TASKS AND PROJECT CHARACTERISTICS 

Having completed the practice experiment, all of the subjects were given an 
additional opportunity to ask questions prior to taking the actual experiment. Some 
questions were asked concerning whether there was any incentive to finish ahead of 
schedule. In response to these questions, the subjects were told the project that they were 
managing was a portion of a larger project. Finishing their portion early would only result 
in dead time for their staff. This left no questions that there was no reward for finishing 
early. 

The subjects were reminded that they were to work alone and not to discuss 
anything with anyone other than the lab attendant. All participants were told that their 
performance on the experiment would be incorporated into their class participation 
portion of the grade for IS-4300. 

B. ORGANIZATION OF THE EXPERIMENT 

The introduction to the actual experiment consisted of a 15 minute training session 
in which each participant was given their personal envelope and informed of its contents. 
The experimental guidelines were reviewed for the last time. A seating chart was 
distributed to each subject and appears as Appendix N. None of the students with similar 
goals were seated next to each other. Prior to the experiment, all of the computers were 
checked to ensure the software would properly run. As noted in the Appendix N, several . 
machines could not run the software and were not used. A final opportunity was provided 
to settle any last minute questions before the participants were directed to the lab. 

The size of the experimental group required that two separate sessions, each 
session split in half and distributed across two labs with an hour in between to allow for 
Separate group briefings. A lab assistant was present in each lab to ensure compliance 
with the seating chart and to provide general guidance throughout the experiment. Lab 


assistants had special copies of the seating chart that also indicated the project and goal set 


re 


of each subject. This was done in the event that any subject’s computer might malfunction 
creating the need for reassignment. Reassignment could then be done ensuring subjects 
with similar goal sets were not seated side by side. The experiment designer served as the 
lab assistant in one lab and made periodic checks with the other lab attendant to ensure 
that all of the subject’s concerns were being handled uniformly between the labs. The 
same persons served as lab attendants in both the Wednesday and Thursday sessions. 
Experimental groups were started an hour apart to allow for more individualized subject 
briefing. No information was given to the subjects on how to calculate staffing levels or 
how to interpret the reports. Both lab assistants had spare disks for each of the eight 
project configurations, and had back-up copies of all of the documentation. The entire 
experiment was conducted over two days. All subjects were completed with the 
experiment within two hours. 
G. THE EXPERIMENTAL SUBJECTS 

The subjects that participated in this experiment were students from two sections 
of the Software Engineering and Management course, IS-4300, taught at the Naval 
Postgraduate School. Section one consisted of 31 students and section two had 24 
students. The subjects were randomized and assigned to each of the eight group sets in 
the following manner. 

1. Random Number Assignment 

Students in the two sections were listed sequentially in the order that they 
appeared on the registration roster. A standard list of random numbers was chosen 
(Daniel, 1975). The last three digits were used. Random numbers were assigned 
sequentially to each subject. 

2. Project Assignment 

The subjects were then sorted by their random number. Now that the subjects 
were in a random order, each was assigned a project in sequence. The projects were 


assigned in the order of All, Al2, A21, A22, B11, B12, B21, B22. 
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D. DEPENDENT MEASURES 

Ten performance variables were captured at the completion of the experiment. Of 
these, three were the most indicative of performance and were used to evaluate project 
performance as the dependent variables. The first of these 1s Final Cost, FNCOST. (See 
Appendix O for the key to deciphering variable names). FNCOST is the cost in person 
days expended to complete the project. 

The second dependent variable is the Final Time. FNTIME is the day that the 
project was completed. All subjects had the goal of completing the project within the 
estimated time. 

The third, and last dependent variable is FNERR. FNERR is the value indicating 
the number of cumulative errors remaining in the software at project completion. This 
value indicated the quality of the software, i.e. fewer errors indicated a higher quality 


product. 


iD 








IV. EXPERIMENTAL RESULTS AND ANALYSIS 


A. MODEL OF ANALYSIS 

For each subject, there were three sets of data captured during the simulation. 
Performance data measuring the project outcome was captured in the file 
PERFORM.DAT. Data was also captured on the five decisions made by a subject in each 
interval, and was stored in the fille PROCESS.DAT. During each interval, data was 
captured on which report or graph subjects viewed and the length of time they viewed It. 
This data was written to the file named CAPTURE.DAT. The three data sets appear as 
Appendices A,B,C, respectively Also, demographic data on each participant in the 
simulation was obtained through the use of a questionnaire contained in Appendix X. 

Analysis of this data was conducted using Statistical Analysis System (SAS) 
software. Procedure MEANS, was used to determine the means and significance. 
Procedure General Linear Model (GLM) was used for multi variate analyses. Procedure 
Correlation was used to detect any correlation between independent and dependent 
variables. The SAS program files appear in Appendix P. 
B. PERFORMANCE DATA 

The analysis of each participants final performance focused on three dependent 
variables final cost, final schedule, and final errors. Figure 4-1 depicts the means and 


standard deviations of the performance variables for the different experimental groups. 


boy 


FNSKED,Mean FNCOST, Mean FNERR, Mean and 
and (Std. Dev) and (Std. Dev) (Std. Dev) 

Project A - Cost 

and Schedule 


Project A - Quality 


and Schedule 
Project B - Cost 
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Figure 4-1 Performance Means and Standard Deviations for the Groups 
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Figure 4-la Performance Means and Standard Deviations by goals and projects 
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I. Means 
The analysis of the above means from Figure 4-1 reveals that all goals were 
Important to the subjects. The mean of the groups that had quality as a goal had fewer 
errors than those groups that did not. The same holds true for those subjects that had cost 
as a goal, those groups had lower mean costs than the groups without cost as a goal. 
Everyone had minimizing schedule as a goal, so it is not surprising there was not a 
substantial difference between groups with respect to schedule. The data in figure 4-la 
showed that the bad feed back of project B definitely increased the mean project schedule 
and cost, as compared to project A. Peculiarly, though, the bad feedback of project B led 
to a better quality product, this was because as subjects with quality as a goal felt they 
were on or ahead of schedule due to erroneous feed back, they put more staff into quality 
assurance to attain a quality product. 
a. Evaluation of variables 
The GLM procedure was used for comparison of the groups performance to 
determine if there were significant differences between the groups. Each group's cost, 
schedule and quality variables were analyzed to determine if they were significant. Then 
the effects of goals and feedback were analyzed on the above variables. 
b. Cost 
For final cost, the GLM procedure yielded (F(4,33)=7.00; P<0.0003). This 
rejects the null hypothesis, thereby that indicating there were significant differences among 
the four experimental groups in terms of cost. Also, there was a strong goals effect 
(F(4,33)=17.39; P<0.0002) on cost. Subjects that had minimizing cost as a goal had 
significantly lower costs compared to subjects that did not have cost as a goal. There was 
not, however, a feedback effect (F(4,33)=1.48; P<.2839), the erroneous feedback given to 
a subject working on project B did not significantly effect his/her cost. 
c. Schedule 
For final schedule the GLM procedure produced (F(4,33)=3.24; P<.0239). This 


rejects the null hypothesis thereby indicating that there were significant differences 


ie 


between groups in terms of schedule. All subjects had the goal of minimizing schedule, 
so there was not a goals effect between groups. However, the order of the goals on the 
subjects instruction sets seemed to have an effect, (F(4,33)=3.24; P<.040) this was 
probably due to the small number of subjects in each experimental group. The erroneous 
feedback given to a subject working on project B, though, did not significantly effect 
his/her final schedule (F(4,33)=2.77; P<. 1058). 
d. Quality 

The GLM procedure for final errors revealed (F(4,33)=3.26, P<0.0233) rejecting 
the null hypothesis thereby indicating significance. There was a significant difference 
between groups in terms of quality. Again, there was a strong goals effect (F(4,33)=4.85; 
P<0.0348). Subjects that had maximizing quality as a goal delivered a product with fewer 
errors than subjects who did not have maximizing quality as a goal. The order of the goals 
was also significant (F(4,33)=4.57; P<0.0401), but again, this was probably due to the 
small number of subjects in each experimental group. However, the erroneous feedback 
of project B did not significantly effect it in terms of quality (F(4,33)=3.21; P<.0823), 
although, the group with erroneous feed back and quality as a goal did have the best 
quality product. 
PROCESS DATA 

The subjects were required to make five decisions at each 40 day interval. The 
first decision was to estimate the productivity of the team (lines of code produced per 
programmer per day). Then each subject selected his/her total staff, percentage of staff 
allocated to quality assurance, and estimates of the projects’ final cost and schedule. The 
actual completion time of the project was dependent on the particular decisions made by 
the manager. In graphing the group means of the process data obtained, the last interval 
used is day 200. This is the last interval in which all of the subjects had not completed the 
project and were still making decisions. An analysis using the SAS GLM procedure was 
used to determine if there was a period effect, second to determine if there was a time 


effect between the four groups, and also to determine if there was significant difference 


Za 


between the subjects of the four groups. 

Three types of analyses were conducted on the means of the process data. The 
first was to determine if there is a period effect, 1.e. the values changed over time. Next, 
the data was analyzed to determine if there was interaction between the groups with 
different goals over time. Lastly, analysis was conducted to determine if there was 


significant difference between subjects. 
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Figure 4-2 Total Staff Requested for Project. 

a. Total Staff 

Figure 4-2 is a graph of the group means for total staff requested by 
participants in the Project. The analysis of the means as shown in the graph indicates that 
there is a period effect. The null hypothesis for no period effect is reyected with respect to 
staff (F(S,31)=5.84, P<0.0007). The null hypothesis for interaction however, cannot be 
rejected (F(S,31)=1 52, P<0.2211) The test for difference between subjects indicates that 
the null hypothesis cannot be rejected, there is no significant difference between subjects 


with different goals (F(1,35)=4.05; P<0.052), or feed back (F(1,35)=1.14; P<0.290). 
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Figure 4-3 Percent of Requested Staff Allocated to QA for Project 

b. Quality Assurance 

Figure 4-3 is a graph of the percent of the total staff allocated to quality 
assurance activities. The analysis of the means as shown in the graph indicates that there 
is no period effect with respect to quality assurance. The null hypothesis for no period 
effect is accepted with respect to quality assurance (F(5,31)=5.84; P<0.336). Also, the 
null hypothesis for interaction between groups over time cannot be rejected 
(F(5,31)=1.41; P<0.249). The test for difference between subjects indicates that the null 
hypothesis can be rejected , there 1s significant difference between subjects with different 
goals (F(1,35)=8.35; P<0.052). For between subjects effects on feed back, however the 
null hypothesis cannot be rejected (F(1,35)=2.71; P<0.111). Feedback was not significant 


with respect to quality assurance. 





Figure 4-4 Estimated Completion Cost for Project 

c. Cost Estimates 

Figure 4-4 depicts the estimate for total project cost for the subjects that 
managed Project. The analysis of the means as shown in the graph indicates that there is a 
period effect with respect to cost. The null hypothesis for no period effect is rejected with 
respect to cost estimates (F(5,31)=8.11; P<0.0001). However, the null hypothesis for 
interaction between groups cannot be rejected (F(5,31)=1.74;-P<0.155). The test for 
difference between subjects indicates that the null hypothesis can not be rejected, 
indicating that there is no significant difference between subjects with different goals 


(RolWes)=2.70»R<0sh10)ioneteed backa(E(35)=236.R<04183): 
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Figure 4-5 Estimated Schedule for Project. 

d. Schedule Estimates 

Figure 4-5 illustrates the subject’s estimated project schedule as the project 
progressed. The analysis of the means as shown in the graph indicates that there is no 
period effect. The null hypothesis for no period effect can not be rejected with respect to 
schedule estimates (F(5,31)=2.13; P<0.089). Also, the null hypothesis for interaction 
between groups cannot be rejected (F(5,31)=1.52; P<0.214). The test for difference 
between subjects indicates that the null hypothesis can not be rejected, indicating that 
there 1s no significant difference between subjects with different goals (F(1,35)=.74, 


P<0.396) or feed back (F(1,35)=0.11; P<0.739). 
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Figure 4-6 Estimated Productivity for Project. 








e. Productivity Estimates 

Figure 4-6 is a graph of the group means for individual staff productivity 
estimated by participants in the Project. The analysis of the means as shown in the graph 
indicates that there is a period effect. The null hypothesis for no period effect is rejected 
with respect to staff productivity (F(5,3 1)=320; P<0.0001). The null hypothesis for 
interaction between groups however, cannot be rejected (F(5,31)=2.22; P<0.077). The 
test for between subjects effects with different goals indicates that the null hypothesis 
cannot be rejected (F(1,35)=3.31;P<0.078). However, the between subjects effects for 
different feed back were significant rejecting the null hypothesis (F(1,35)=21.23; 
P<0.0001). 
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1). QUESTIONNAIRE AND DEMOGRAPHIC DATA 
After completion of the project, each participant filled out a questionnaire. The 
last page of the questionnaire was devoted entirely to demographics. The data format can 


be found in Appendix Q. 





Figure 4-7 Group means and standard deviation demographics 


Figure 4.7 represents the sample demographics profile by group. Age represents 
the average age of the participant, CHRSWK represents the mean number of hours spent 
using a computer per week, WKEXP represents work experience in years, and EDAGO is 
the number of years since the subject completed his undergraduate education. Group A] 
was the oldest, had the most work experience, spent the most time on a computer per 
week, and had completed their undergraduate education the longest ago. Group B2 was 
the youngest spent the second greatest time on a computer per week and tied with group 


B2 for having the most recent undergraduate experience. 


Zi 








V. CONCLUSIONS 


A. FINDINGS AND IMPLICATIONS 

The objective of this thesis was to conduct a controlled experiment focused on 
gaining insight into the interaction between feedback and stated goals on software project 
management. This thesis provides significant findings regarding the software project 
managers’s behavior in both accurate and erroneous feedback environments. 

The experimental results confirm that goals do matter to software development 
managers. Managers perform best in the goals that they are given. Additionally, it 
confirms that different software development goals, 1.e. quality, cost, and schedule are 
indeed in conflict with each other. 

The experimental results did not, however, find any significant differences between 
the groups given different feedback. Only two reasons for this exist, either goals 
overwhelm feedback, or more than likely, the small group size of this experiment caused 


the feedback results to be insignificant. 


B. FURTHER RESEARCH 

There are several more areas that can be researched using the Systems Dynamic 
Model of Software Project Management. One particular area would be to conduct the 
experiment with professional software manages to see if they respond similarly to stated 
goals. Project outcome could differ when managed by professional managers. 

Another area to be researched concerns goal commitment. In this thesis goals 
were given to the manager and no attempt was made to analyze the level of commitment. 
Further research could be conducted to measure both the initial commitment to the goals 
and whether this commitment was maintained over time. 

Lastly, interaction between feedback and goal commitment could be researched 
using more subjects. In this thesis, there were differences in performance that occurred 


due to feedback, but the group size was to small for them to be significant 
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APPENDIX A. PROJECT@.BAT 


@echo off 
rem PROJA initially underestimated project 


cls 

rem init.exe requires 3 parameters i.e. [project,group,ins.set] 
Bait Al 2 

eraphics 

bat /n /p /s 

ram 

smlt PROJA -go = -prs = -ls -ns -plm 16 


rep PROJA.RSL PROCESS.DRS -outf PROCESS.OUT -t >NUL 
rep PROJA.RSL PROCESS.DRS -outf PROCESSS.OUT -t >NUL 


eCOp 


Scop] 


dynex PROJA -in PROJA.STT -sc -ls -plm 16 
smlt PROJA -gm = -ns -plm 16 


copy process.out process.old >NUL 

rep PROJA.RSL PROCESS.DRS -outf PROCESS.OUT -t >NUL 
rep PROJA.RSL PROCESS.DRS -outf PROCESSS.OUT >NUL 

rep PROJA.RSL INTERVAL.DRS -outf INTERVAL.OUT -t >NUL 
process 


eal —topl 

rep PROJA.RSL PERFORM.DRS -outf PERFORM.OUT -t >NUL 
perform 

rem finish 

exit 


cls 


-~PROGREP kKkKK*K VIEW PROGRESS KKK KKKKKKKKKKKKKEKKEKKKKKK KKK KK KKK 


anenu 





timestmp 

rep PROJA PROGRESS.DRS -outf PROGRESS.OUT -t -sc -ls -plm 16 
inkey 

Gapeure RS >NUL 

Cals 

Gower \1F 


Soror \1F 
cls 
begtype 


or 





REPORTS AND GRAPHS MENU 


\ LEREPORTS: 


pelo oe aL 
ir 
ir 
1k 
it 
ie 
if 
pe 


\ 1BGRAPHS: 


PRESS 


\1F 
\1E 1 


\1E 2 


\1E 3 


\1E 4 


\1F 


VIBES 


\1B 6 


\1B 7 


\1B 8 


\1D P 


\1F 


\1F 


\1F 


\1F 


Vir 


\1F 


\1F 


\1F 


\1F 


Choose an option: 


PROJECT STATUS \1EREPORT\1F 


DEFECT \1EREPORT\1F 


| 
| 
| 
| 
STAFFING \1EREPORT\1F 
CUMULATIVE \1EREPORT\1F | 

| 


PROJECT PROGRESS \1BGRAPH\1F 


COST AND DURATION \1BGRAPH\1F 


| 
| 
| 
| 
STAFFING \1BGRAPH\1F 
DEFECT STATUS \1BGRAPH\1F | 

| 


| 
(Do NOT hit <ENTER> after selection!!!); ! 


inkey %2 | CYpChee; 
SoTAITREP 
-STAFREP 
-DEFREP 
-CUMREP 
-~FEEDPLOT 
=o LAF PLOT. 
~DEFPLOT 


%2 


Woof 


goto 
Jere 
goto 
goto 
goto 
Goce 
goto 


oom f& WN F&F 


oz 


af. $2 


7 goto -COSTPLOT 
ee bic P goto -proceed 
me %2 KEY0O11 return 
beep goto -menu 


-STATREP **** VIEW PROJECT STATUS REPORT ** KK KKK KKK KK KKK KKK 
timestmp 
rep PROJA STATUS.DRS -outf STATUS.OUT -t -sc -ls =—plmete 
inkey 
Capture R1 >NUL 
cls 
eelor \1F 
goto -menu 


-STAFREP KKKK VIEW STAFFING REPORT RHEKKKKKKKKKKKK KKK KKK 
timestmp 
rep PROJA STAFFING.DRS -outf STAFFING.OUT -t -sc -ls =—plineG 
inkey 
Capture R2 >NUL 
cls 
Sator \1F 
goto -menu 


-DEFREP ***X* VIEW DEFECT REPORT KX RK KKKKKKKKKKKKKKKK 
timestmp 
rep PROJA DEF.DRS -outf DEF.OUT -t -sc -ls -plm 16 
inkey 
capture R3 >NUL 
cls 
cOl@r \1F 
goto -menu 


-CUMREP **** VIEW PROJECT CUMULATIVE REPORT #4 kK RR KKK KKK KK KK KEK 
timestmp 
rep PROJA CUM.DRS -outf CUM.OUT -t -sc -ls —piml6 
inkey 
Capture R4 >NUL 
cls 
Solor \1F 
goto -menu 


ao 


-COSTPLOT **** VIEW PROJECT STATUS PLOT **** 
timestmp 
cls 
Soong yl 
begtype 


KAKKKKKAK KKK KKK AK KK KAKAAKKEKKKEKEKKKEKKKEKEKKEKKEKEKKEKKEKEKKK KEK KEKE KKK KKEKKEKEKE KEKE KKKKKKKEAK KEKE KK 


\1A PROJECT COST VARIABLES Vie 


KREKKEKKKKKKKKKKEKKEKE KKK KEKE KKK KEKE KKEKKEKEKEKEKEKKEKKEKEKK KKK KKKREKRKKEKKEKKEKEKEKEKEKEKRKKKKKKEK 


THE FOLLOWING PROJECT STATUS VARIABLES WILL BE PLOTTED: 


EST OF PROGRAMMING PHASE COST. .... . . . PERSON DAYS 
EST OF PROGRAMMING PHASE DURATION Ses -e- st AS 
\1A AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU \I1F 
\1A PRESS <ENTER> TO VIEW PLOT \1F 
end 
inkey 
cls 


rep PROJA STATPLOT.DRS 
capture G8 >NUL 

Golor Vir 

cls 

Jelo: —menu 


—=SRAPe LOL *“s*SVIEWVGRRePHtC STAFFING PLOT *«*x* 
timestmp 
c lis 
COl@n 
begtype 
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Me NN ARR KAAERARRERKERKEER KK IRR ERE © K decele ek AK Kk kK HK kk ee ON ew ge 


\1A STAFFING VARIABLES \1F 


Re NKR RRR ARERR KAA K EK AKER REAR REE RR RR KEKKKRKKEK KE EKKERRRERENNE EEE EKER 


THE FOLLOWING STAFFING VARIABLES WILL BE PLOTTED: 


TOTAL STAFF ..... . . TOTAL STAFF LEVEL 
Bemornrr. . . ... =. . =. NUMBER OF PERSONS ALLOCATED TO QA 
PROG STAFF. . . . . . . . NUMBER OF PERSONS DOING PROGRAMMING 


ALA AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE VILE 
\1A PRESS <ENTER> TO VIEW PLOT \1F 
end 
inkey 
cls 


rep PROJA STAFPLOT.DRS 
capture G6 >NUL 

SelGr \1F 

cls 

goto -menu 


~DEFPLOT **** VIEW DEFECT PLOT **** 
timestmp 
cls 
Geouor \1F 
begtype 


RRR RRR RR RICK KE IK ERK K RRR RK CHEK REN EKER REE EK ERE ORES 
\1A DEFECT VARIABLES Ne 


RR TARE K AA KAKA HAKKAR RANK IKK ARK KW KKK RENE ERR KMWARKRRERHKEAAENA EKER RG RA EES 


THE FOLLOWING DEFECT VARIABLES WILL BE PLOITED: 


oD 


QA PERSON DAYS PER PERIOD .. . . QA PERSON DAYS EXPENDED PER PERIOD 


DEFECTS DETECTED PER PERIOD .. . DEFECTS DETECTED PER PERIOD 
\1A AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU \1F 
\1A PRESS <ENTER> TO VIEW PLOT NUE 
END 
inkey 
cls 


rep PROJASDEFPLOTSDRS 
capture G7 >NUL 

eolor \ik 

cls 

goto -menu 


-FEEDPLOT **** VIEW DEFECT PLOT **** 
timestmp 
cls 
color iF 
Degey pe 


KKKKKKKKKEKEKEKEKK KKK KKK KKK KEKE KKK KKK K KKK KKK KKK KKK KKK KKK KKK KEKE KKK KEKE KKK KKK KKK KKKKKKK KK 


\1A PERCENT COMPLETION VARIABLES \ ae 


RKAKKKKKKKEKKKKKKKK KK KKK KEK KKK KKK KK KK KK KKK KKK KKK KKKK KKK KK KKK REK KKK KKK KKKKKKKKEKKKKKKEK 


THE FOLLOWING VARIABLES WILL BE PLOTTED: 


PLANNED PERCENTAGE COMPLETION RATE . . . PERCENT KDSI 
PERCENT DSI REPORTED COMPLETE .. .. . PERCENT KDSI 
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\1A AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU \I1F 


\1A PRESS <ENTER> TO VIEW PLOT Nie 


END 
inkey 
els 
rep PROJA FEEDPLOT.DRS 
Capture G5 >NUL 
Solor \1F 
els 
goto -menu 


-proceed **** PROCEED WITH NEXT SIMULATION # #44 4 Xk kkk KK OK 


cls 
setor \1F 
begtype 
REE KEK KKK RK RRR KREK KKK KKK KEKE 
* Press <ENTER> to continue * 
KRKKKKKKKKKK KKH KKK KKK KKK KKK KKK KEK KEKKEKKK KKK KKK KK KEK 
end 
goto -top 


fey, CYTror- 
mecR > &2 if $R < 90 type !! Floating Point Error !! | goto Ca hee 


Cls beep type Unexpected batch file error %@R in line %L Jexit 


ory 





APPENDIX B. PROJ@.DNX 


if #tm<.1 then 
Seoplay clear 


RKEKKKKKEKKKKEKEKKKEKKEKRKEKEKEKRKEKEEKKEKRKEKKEKREKES 


!!'!! Important Points to Remember !!!! 
KRREKKEKKKKEKKKKEKEKKE KEKE KERR KEKKEKKKKEREREREKREESE 


- You are not allowed to discuss this exercise with anyone other 
than the lab attendant. Please refrain from discussing this with 
members in the other class until they have completed the exercise. 


- The system will show you the size of the initial core team of 
software developers who have just completed the requirements/design 
specifications. You will then be asked for your desired staffing level 
for the programming phase. Then, the system will run through the 
first simulation time period (40 working days) and allow you to view 
various reports and graphs. You will then be allowed to update your 
estimates for project cost and duration and change your staffing levels. 


- Record your decision for each interval on the documentation sheet 
provided before proceeding to the next interval. 
THE LAB ATTENDANT MUST VERIFY YOUR FINAL RESULTS! 
- GOOD LUCK! Press <ENTER> to continue. 
dendg 
@enoice 1 
cend 1/1 
display clear 


KAKA KKKRKRKEK HARKER KEKE KEKE KKK KEKKEKEKEKE KKK KEK KK EERE K KEKE KKK KEKE KKK KEKE KREKEKKKKKEKK KKK 


INITIAL ESTIMATES FOR THIS PROJECT: * 
w System Size 24400. DSI * 
* Cost of Programming Phase #TOTMD1 Person Days * 
* Duration of Programming Phase #TDEV Days * 
* * 
x The initial core team of software developers who have just * 
a completed the requirements and design specifications is * 
- #WFS1 people. * 
* * 
* Your task is to take over as manager of the programming phase. * 
* At this point, you need to make 2 decisions: * 
* * 
* * 


1. The total staff level for the programming phase. 


ao 


* * 


Cee ee PereceieOLethnisS Stariteto allocate to QOuality Assurance. = 
KAKAKKKKKKKKKHR RK KEK KKK HAKKAR KKKKKKRKEK KK KKK KKK EAE KK KK KKH K KKK KKK KE KKK KKK KKKKAKKK 


----- > FIRST DECISION: The total staff level 
Enter your total requested staff level and press <ENTER>. 
dendg 


dq WFS1=0.5< 
display clear 


----- > SECOND DECISION: 

NEW TO@E Ss estimate for Ehe percent of the total staff to allocates amas 
is #FRMPQA percent. Remember, NEW TOOL has not yet been calibrated to your 
environment. Thus, this estimate is merely illustrative. It may or may 


not be appropriate for your unique project. 


1) Enter a different desired percentage (a number from 0 - 100) 
and press <ENTER>. 


OR 


2) Press <ENTER> to allocate #FRMPQA percent of your staff to QA. 


dendgq 
dq FRMPQA=0<100 


display (clear 


Your total requested staffing level = #WFS1 people. 

The percent to be devoted to QA activities = #FRMPQA percent. 

(This means that you are devoting #WFS1 * #FRMPQA / 100 = #WFS1*FRMPQA/100 people 
to QA) 


KEKE KKKKEKKKKKAKEKKKEKAKK KKK KKK KKK KAKA KKK KAKKRKAK KAKA K KKK EK 


* !! IMPORTANT !! 


This Deh youreeimal oppereunity =soeeneck arid 
change the values for this period. 


Press 1 then <ENTER> to change these values. 


If all values are correct, record them on 
the documentation sheet provided then 


+ * + + LF 4+ F 


+ 


* Press 2 then <ENTER> to continue. 


% 3 Ee oe ok ek 


40 


RREKAEKKEKRKAEKKAKKEKKKEK KEKE KEKE KA K KE KKK KE KK KKK KEKE KKK KKK KKK KE KKKKEKK KK 


dend 
enoice 2 


display 

Your total requested staffing level = 
dendgq 

dq WFS1=0.5< 


display 

The percent allocated to QA = 
dendgq 

dq FRMPQA=0<100 


cend 
cend 


else 


choice 1 
cend 1/1 


display clear 
RREEKEKKEKEK KKK KEK KK KEK KEK KKK KEK KEKE KEK KEK KEK KKK KKK KK KEAKKK KKK 


* Make Your Desired Changes To The Variables Z 
* and press <ENTER> a 
* OR * 
* Press <ENTER> to keep the displayed value * 


RARER KKK KEKE KKK KEKE KKK KEKE KE KKK KK KKK KKKKKKKEKK KKK KKK 


Your updated estimate for productivity (DSI/person days) = 
dendg 
dq PRODTY=0< 


display 

Your updated estimate for project cost (person days) = 
dendg 

aq TOTMD1=0< 


display 

Your updated estimate for project duration (days) = 
dendgq 

dq PROJDR=0< 


display 

Your total requested staffing level = 
dendq 

dq WFS1=0.5< 
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display 

The percent to allocate to QA (a number from 0 - 100) = 
dendg 

dq FRMPQA=0<100 


display clear 


YOur updated estimate for productivity #PRODTY DSI/person-day 


Your updated estimate for project cost = #TOTMD1 person days 

Your updated estimate for project duration = #PROJDR days 

Your total requested staffing level = #WFS1 people 

The percent to be devoted to QA activities = #FRMPQA percent 

(This means that you are devoting #WFS1 * #FRMPQA / 100 = #WFS1*FRMPQA/100 people 
to OA} 
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KAEAKKKE KKK KEKE KEKE KKK KEKE KEKE KEKE KEK KEKE KEKE KERR KEKE KEKE KEKE KKK KK KKK 


* !! IMPORTANT !! * 
* * 
. This is your final opportunity to check and * 
* Change the values for this period. * 
* * 
x Press 1 then <ENTER> to change these values. * 
* * 
* If all values are correct, record them on x 
* the documentation sheet provided then * 
* * 
* Press 2 then <ENTER> to continue. * 
* * 
KREKEKEKEKEKKEKEKEKHEKEKEKEKE EKER KEKE KEKE KEKE KEKE KKK KKK KKE KKK KKK KK 


dend 
ehoice 2 


display 

Your updated estimate for productivity (DSI/person days) = 
dendg 

dq PRODTY=0< 


display 

The updated estimate for project cost (person days) = 
dendg 

dq TOTMD1=0< 


display 

The updated estimate for project duration (days) = 
dendg 

dq PROJDR=0< 


display 

Your total requested staffing level = 
dendg 

dq WFS1=0.5< 


display 

The percent allocated to QA = 
dendg 

dq FRMPQA=0<100 


cend 
cend 


end 
display clear 
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ARK KKKKKEKKREKE KE KKK KK KEKE KKK KEK KEKE KKK KEK KKK KKK KK KK KK KKK EK KKK KKK KK KKK KKEK KK KK 


x * 
* Press <ENTER> to simulate this interval and return to the menu. x 
* * 


KAKA KE KEK KEK KKK KEK KK KKK KKK KEKKEKEKKKEKEKKE KKK KEKE KKK KEK KEKE KEKE KEKE KEKE KEKE KKK 
dendg 
choices 
display clear 


RAEKKEKKKEKKEKEKKKKKKEKK KEK KEKE KEKE KEKE KK KKK KKKKKEKKE 


* * 
3 < 
x There will be a short pause while * 
* the model simulates the next period. * 
* * 
* * 
RREKKKKKKKKKKKKEKKKKKKEK KKK KKEKEK KEKE KKK KKEKKE EK 


dendq 

Teper. 
time=maxtime, 
cend 1/1 


spec md_length=#length+40 
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APPENDIX C. TOY. BAT 


Gecho off 
rem PROJA initially underestimated project 


Els 

rem init.exe requires 3 parameters i.e. [{project,group,ins.set] 
mit Al 2 

graphics 

bat /n /p /s 

ram 

Smet PROJA -go = -prs = -ls -ns -plm 16 


rep PROJA.RSL PROCESS.DRS -outf PROCESS.OUT -t >NUL 
rep PROJA.RSL PROCESS.DRS -outf PROCESSS.OUT -t >NUL 


top aiymex PROJA -in PROJA.STT -se -ls -plim 16 
smlt PROJA -gm = -ns -plm 16 


Copy process.out process.old >NUL 

rep PROJA.RSL PROCESS.DRS -outf PROCESS.OUT -t >NUL 
rep PROJA.RSL PROCESS.DRS -outf PROCESSS.OUT >NUL 

rep PROJA.RSL INTERVAL.DRS -outf INTERVAL.OUT -t >NUL 
process 


eal -topl 

rep PROJA.RSL PERFORM.DRS -outf PERFORM.OUT -t >NUL 
perform 

rem finish 

exit 


Scop cls 


-PROGREP xxx*k VI REW PROGRESS KX®RKK KKK KKK KKKKKKKKKKKKKKKKKKKKKK 
timestmp 
rep PROJA PROGRESS.DRS -outf PROGRESS.OUT -t -sc -ls -plm 16 
inkey 
Capture R5 >NUL 
Gis 
@olor \1F 


-menu 
eelor \1F 
cls 
begtype 
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——— 


REPORTS AND GRAPHS MENU 


\ LEREPORTS : 


end 


-lstkeyl 
if 
ee 
ut 
iets 
Lf 
tf 
LE 
aye 


\ 1BGRAPHS: 


PRESS 


Choose 


Y 





\1F 

\1E 1 \1F PROJECT STATUS \1EREPORT\1F 

\1E 2 \1F STAFFING \1EREPORT\1F | 

el Ear \1F DEFECT \1lEREPORT\1F 

\1E 4 \1F CUMULATIVE \1EREPORT\1F 

le 

\1B 5 \1F PROJECT PROGRESS \1BGRAPH\1F | 

\1B 6 \1F STAFFING \1BGRAPH\1F 

VIB 7 \1F COST AND DURATION \1BGRAPH\1F 

\1B 8 \1F DEFECT STATUS \1BGRAPH\1F 

\a DP \1F TO \1DPROCEED\1F TO ENTER DECISIONS FOR THE NEXT 40 DAYS 

an option: (Do NOT hit <ENTER> after selection!!!); | 
%2 type %2; 

i goto =STATREP 

2 Goto -STAtREe 

3 QOtEo: ~DEFRur 

4 goto -CUMREP 

» Goto —-FEEDELOT 

6 goto -STAFPLOT 

8 goto. -DEReLor 

7 ‘Gouo. —COstPLorT 
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LE 2 P goto -proceed 
if %2 KEYO11 return 
beep goto -menu 


of gl 


~STATREP **** VIEW PROJECT STATUS REPORT *** KX KKKKKKKKKKKK KX 
timestmp 
rep PROJA STATUS.DRS ~-outf STATUS.OUT -t -sc -ls -plm 16 
inkey 
capture Rl >NUL 
cls 
eelear \1F 
goto =menu 


~STAFREP *k*k*k VYIEW STAFFING REPORT *** XR XKKKKKKKKKKKK KK 
timestmp 
rep PROJA STAFFING.DRS -outf STAFFING.OUT -t -sc -ls -plm 16 
inkey 
capture R2 >NUL 
cls 
ee@i1or \1F 
Gero =menu 


‘-DEFREP xx**x VIEW DEFECT REPORT * #44 RK KKKKKKKKKKKKAK 
timestmp 
BemeeROJA DEF.DRS -outf DEF.OUT -t -sce -ls -plm 16 
inkey 
Capture R3 >NUL 
cls 
cetorw\1Fr 
goto -menu 


=-CUMREP **** VIEW PROJECT CUMULATIVE REPORT ** XX RR KKKKKKKKKKKKEKE 
timestmp 
Bom ROA CUM.DRS -outf CUM.OUT -t -sc -ls -plm 16 
inkey 
capture R4 >NUL 
cls 
Solor \1F 
goto -menu 
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-~COSTPLOT **** VIEW PROJECT STATUS PLOT **x* 
timestmp 
Gils 
eolor Vir 
begtype 


KAEKKKEKKKKKKKEKEKRKE KEKE KEKE KEKE KEK KKK KKK KKK K KEK KE KKK KKK KEKE KK KEK KKK K KKK KK KKK KEKEKEKKKEKKEK KKK 


\1A PROJECT COST VARIABLES ae 


AKA AK KKK KKK AKER KEKE KKK KEKE KKK KKK KKK KKAK AK KKK KAKA K KEKE KK KEK KK KEK KKK KKK KKK KKK KKK KKAEKK KKK KKK 


THE FOLLOWING PROJECT STATUS VARIABLES WILL BE PLOTTED: 


EST OF PROGRAMMING PHASE COST. .... . . +. PERSON DAYS 
EST OF PROGRAMMING PHASE DURATION - yeas DAYS 
\1A AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU NE 
\1A PRESS <ENTER> TO VIEW PLOT \1F 
end 
inkey 
cls 


rep PROJA STATPLOT.DRS 
capture G8 >NUL 

Color mF 

cls 

goto —-menu 


Sono l =~ =~ TEWsGRAPHIC STARFING PLOT **** 
timestmp 
cls 
Color a1 F 
begtype 
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Ree KAR AKKKKKKKKKARKARKKKKKKKKERAK AK KR RKKKRAKKAKKKKKAKAKAKR KR RARE RR OR 


\1A STAFFING VARIABLES \1F 


Se AER R KKK KKK KEK KARR KK KKK KKKEKK KK KEK KEK KK KKK KK KKK KKK KKK KKK KEKE KREKK KK KEKKKKKEREKERE 


THE FOLLOWING STAFFING VARIABLES WILL BE PLOTTED: 


BOTAL STAFFER. 2. .. . . TOTAL STAFF LEVEL 
QA STAFF. . . . . . . . . NUMBER OF PERSONS ALLOCATED TO QA 
PROG STAFF. . .. . . . . NUMBER OF PERSONS DOING PROGRAMMING 
\1A AFTER VIEWING PLOT PRESS <ESC> TO CONTINUE \1F 
VLA PRESS <ENTER> TO VIEW PLOT Vie 
end 
inkey 
els 


rep PROJA STAFPLOT.DRS 
capture G6 >NUL 

Geotor \1F 

cls 

goto -menu 


SPEFPLOT **** VIEW DEFECT PLOT **** 
timestmp 
cls 
color \1F 
begtype 


eg © 6 RAE KK KK KKK KKK RK KKK IK KK KKK KKK KKK KKK KKK KKK RR KE KAR KK RKKRERKKERKKKKE 
\1A DEFECT VARIABLES Vr 


Me RAK RR RK RIK KK RRR KK RIK KERR KKK KR KICKER IKK RE KKK RR EK KKK KRRKKENRKKERKERKEES 


THE FOLLOWING DEFECT VARIABLES WILL BE PLOTTED: 


QA PERSON DAYS PER PERIOD... . QA PERSON DAYS EXPENDED PER PERIOD 
DEFECTS DETECTED PER PERIOD . . . DEFECTS DETECTED PER PERIOD 
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NA AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU \1F 


\1A PRESS <ENTER> TO VIEW PLOT Vie 


END 
inkey 
cls 
rep PROJA DEFPLOT.DRS 
Capture G7 >NUL 
color V1 
cls 
goto -menu 


~PREDPEOT **** VIEW DEFECT PLOT **** 
timestmp 
es 
COlOna ya. 
begtype 


REA KKKKKKKEKKEKKKEKKEKKEKKE KKK KKK KKK KK KKK KKK KKKAKEKE KEK KKK KKK KEKE KKK KE KKK KKK KKK KKEKEKKKKKKKE KKK 


\1A PERCENT COMPLETION VARIABLES Nas 


KRAKKKKKKKKK KEK KEKE KKEKKE KKK KKK KKK KEK KEKE KKK KEKEKKKKKEKEKKKKKKKEKEKKKKEKKEKKKEKKKE KEKE KKE KKK KEKE KEK 


THE FOLLOWING VARIABLES WILL BE PLOTTED: 


PLANNED PERCENTAGE COMPLETION RATE . . . PERCENT KDSI 
PERCENT DSI REPORTED COMPLETE .. . . . PERCENT KDSI 
\1A AFTER VIEWING PLOT PRESS <ESC> TO RETURN TO THE MENU \1F 
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\1A PRESS <ENTER> TO VIEW PLOT \1F 


END 
inkey 
cls 
rep PROJA FEEDPLOT.DRS 
capture G5 >NUL 
Selor \1F 
els 
Goto -menu 


“proceed **** PROCEED WITH NEXT SIMULATION *&*# eR RRR KK KK RK 


cls 
eelor \1F 
begtype 
KAKA KRKK KKK KKK KKKKKKKKKKKKEKKKKK KKK KKK KKK KKK KAR KKK 
- Press <ENTER> to continue 8 
KRKEK KKK KKK KKK KKK KKK KKK KKK KEK KKKKK KKK KKK KK KKK KK KR KEK 
nc 
goto -top 
mon.error- 
me tR > 824f tR < 90 type !! Floating -Polnk Brerorn! | | goto =Calke. 


Cls beep type Unexpected batch file error %R in line 8L lexit 


oy 


a 





APPENDIX D. STATUS.DRS 


° 
f 


f 


report 
time=maxtime, 
FORMAT="5<" 


"SO>>>>>>>>>>>>>>>>>>>>>> PROJECT STATUS REPORT 

K <<<"; 

Format="30<,40<,47<", PICTURE="Z,ZZ9V" 

wat TIME =",TM, "DAYS" >> 

Format="5<" 

"INITIAL ESTIMATES: (These will not change throughout the project)"; 
FORMAT="8<,54<, 66<", PICTURE="22Z,2Z2Z2ZV" 

"System Size", IPRJSZ,"DSI"; 

FORMAT="8<,54<,66<", PICTURE="ZZZ, ZZZV" 

"Programming Cost",TOTMDO,"Person Days"; 
FORMAT="8<,54<, 66<", PICTURE="22Z2Z, ZZZV" 

"Programming Phase Duration (start-end)",TDEV, "Days"; 
Format="5<" 

“UPDATED ESTIMATES"; 
FORMAT="8<,54<, 66<", PICTURE="22ZZ, ZZ9V" 

"Your Last Est of Programming Phase Cost",JBSZMD,"Person Days"; 
FORMAT="8<, 54<, 66<", PICTURE="2ZZZ, ZZ9V" 

"Your Last Est of Prog Phase Duration (start-end)",SCHCDT, "Days"; 
FORMAT="8<,54<,66<", PICTURE="22ZZ,ZZ9V" 

“Time Remaining", TIMERM, "Days"; 

; 

Pecmat="5<" 

"REPORTED PROGRESS"; 
FORMAT="8<,54<, 66<", PICTURE="2Z2ZZ, ZZ9V.99" 

"% DSI Reported Complete",PRCMPL, "Percent"; 
FORMAT="8<,54<,66<", PICTURE="222,Z2Z29V" 

"Total DSI Reported Complete to Date",CMDSI,"DSI"; 
FORMAT="8<,54<,66<", PICTURE="Z22Z, ZZ29V" 

"Total Person Days Expended to Date",CUMMD,"Person Days"; 
FORMAT="8<,54<,66<", PICTURE="22ZZ, ZZ9V" 

"Reported Productivity",RPPROD,"DSI/Person Day"; 
FORMAT="5<" 

“PRESS <ENTER> TO RETURN TO THE MENU" 





APPENDIX E. STAFFING.DRS 


e 
f 


; 


report 
time=maxtime, 
FORMAT="5<" 


">>>>>>>>>>>>>>>>>>>>>>>>>>> STAFFING REPORT 

CC COCO CCCCOCCCOCOCCCCOCOCCCCCCCOAM 
Format="30<, 40<,47<", PICTURE="Z,ZZ9V" 

"AT TIME =",TM, "DAYS"; 

f 

FORMAT="8<,54<,66<", PICTURE="2ZZZ, ZZZV.9" 

"Current Total Staff Size", FTEQWF, "People"; 
FORMAT="11<,54<, 66<", PICTURE="2ZZZ,ZZZV.9" 

"Staff Allocated to Programming",CRDVWF,"People"; 
FORMAT="11<,54<,66<", PICTURE="ZZZ,Z2Z2V.9" 

"Staff Allocated to QA",CROAWF, "People"; ; 
FORMAT="8<,54<,66<", PICTURE="2Z,ZZZ9V" 

"Percent of Workforce that is Experienced", FRWFEX*100, "Percent"; 
f 

FORMAT="5<" 

"PRESS <ENTER> TO RETURN TO THE MENU"; 


oe 
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APPENDIX F. DEF.DRS 


° 
? 


f 


meport 
time=maxtime, 
FORMAT="5<" 


">>>>>>>>>>>>>>>>>>>>>>>>>>> DEFECT REPORT 

a<<<<< <<< <del ddd"; 

FORMAT="1<,69<,72<", PICTURE="ZZ9V" 

———— = CUMULATIVE STATUS FROM START OF PROGRAMMING TO CURRENT DAY 
re bey 

FORMAT="8<,54<,66<", PICTURE="Z2ZZ,ZZ9V" 

"TOTAL Defects Detected",CMERD, "Defects"; 

FORMAT="8<,54<,66<", PICTURE="2Z2ZZ, ZZ9V.99" 

PTOTAL KDSI Completed", CMDS1/1000,“KDSI"; 

FORMAT="8< , 54<, 66<", PICTURE="22Z2Z, ZZ9V.9" 

"Defect Density"”,CMERD*1000/CMDSI,"Defects/KDSI"; 
FORMAT="8<,54<,66<", PICTURE="22Z, ZZZV" 

"QA Person Days Expended to Date",CMQAMD,"Person Days"; 
FORMAT="8< ,54<, 66<", PICTURE="2ZZ,ZZZ2V" 

"Programming Person Days Expended to Date",CUMMD-CMQAMD,"Person Days"; 
PORMAT="J1<,54<,66<", PICTURE="2Z22Z, ZZ2V" 

"TOTAL Person Days Expended to Date",CUMMD,"Person Days"; 


FORMAT="1<" 


FORMAT="8<, 54<, 66<", PICTURE="2Z2ZZ, ZZZV" 

"QA Person Days Expended Last 40 Days", PRQOAMD, "Days"; 
FORMAT="8<,54<,66<", PICTURE="2Z2Z,ZZ9V" 

“Defects Detected Last 40 Days",PRERD, "Defects"; 
FORMAT="8<,54<, 66<", PICTURE="2Z22ZZ, ZZ9V.9" 

"Defect Density Observed Last 40 Days",PRDFDS,"Defects/KDSI"; 
; 

FORMAT="5<" 

"PRESS <ENTER> TO RETURN TO THE MENU"; 


5) || 





APPENDIX G. *PLOT.DRS FILES 


STATPLOT.DRS: 


plotxy <TM"TIME (DAYS) ",0,480>, 

<SCHCDT"EST PROGRAMMING PHASE DURATION (START-END) ",0,440>, 
<JBSZMD"EST PROGRAMMING COST (PERSON DAYS) ",0,4000> 

STAFPLOT.DRS: 

plotxy <TM"TIME (DAYS) ",0,480>,<FTEQWF"TOTAL STAFF (PERSONS) ",0,24>, 


<CRQAWF"QA STAFF (PERSONS) ",0,24>,<CRDVWF"PROG STAFF (PERSONS) 
",0,24> 


DEFPLOT.DRS: 


plotxy <TM"TIME (DAYS) ",0,600>,<PRQAMD"QA PERSON DAYS PER PERIOD 
",0,240>,<PRERD"DEFECTS DETECTED PER PERIOD ",0,240> 


FEEDPLOT.DRS: 
plotxy <TM"TIME (DAYS) ",0,480>, 


<PLAN " PLANNED % COMPLETION RATE",0,100>, 
<REPRT" % DSI REPORTED COMPLETED ",0,100> 


oe 
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start.bat 
cls 

@echo off 
@echo. 
@echo. 
@echo 
@echo. 


@echo Copying files. 


@echo. 

Miki C:\preja2l 
copy. *.%mc:\proja21 
om 

edie: \proja2 1 

cls 

proja 


finish.bat 
echo off 
els 

eopy *.* b: 


APPENDIX H: START/FINISH.BAT 


Starting the Project Simulation. 


e* ¢@¢ 
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APPENDIX I. All INSTRUCTION SET 
Your Name: All 
SMC No.: 


1. Introduction 


The exercise you are about to undertake is similar in many ways to flight simulators that 
pilots use to mimic flying an aircraft from takeoff at point A to landing at point B. Instead ot 
flying an aircraft, though, the simulator mimics the programming phase of a real software project. 
In this simulation, you will be more than an observer. In fact, you will play the role of manager 
of the programming phase of the project. Specifically, your role will be to track the progress of 
the project by reviewing status reports and graphs available every two-month interval (40 working 
days) during the programming phase. As the manager, you must then make two staffing 
decisions. First, the total number of staff you need. (You can hire additional staff, or decrease 
the staffing level as you deem necessary to complete your programming task successtully.) 
Second, you need to decide on what percent of your total staff to allocate to the Quality Assurance 
activity to be conducted throughout the programming phase (e.g. to do inspections). 


2. Project 
The project that you will manage happens to have been a real project conducted in a real 


organization. For the project, you will be given a project profile containing the following initial 
information: 


Estimated Size of the System: in Delivered Source Instructions (DSI) 
Estimated Cost of Programming Phase: in Number of Person Days 

Estimated Duration of Programming Phase: in Number of Work Days 

Size of initial Core Team: in People 


The Core Team is a skeleton staff of sottware professionals who are there to ensure 
continuity between the requirements/design phase (which you may assume has just been 
completed), and the programming phase you are to manage. 


The cost and schedule estimates are derived from a new off-the-shelf estimation tool, call 
it NEW TOOL", that has been recently acquired. 


Historically, the defect density (i.e. number of defects detected during programming 
divided by the number of KDSI developed) has ranged from 5 - 20 Defects/KDSI. 
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3. Your task 

Your task at every 40-day interval is to review the project's status, and make any 
necessary adjustments to the staffing level and its allocation. In order to do so, you may feel that 
is necessary to first adjust the project's cost and duration targets. The staffing decision should be 
done as follows: 


1. Decide on the total staffing level, and 


2. Decide on what percentage of the staff should be allocated to the quality assurance 
function (i.e. a number between 0 and 100). 


4. Your Goal for the Task: 


Minimize total cost incurred and minimize schedule 


overrun. 





Your grade for the simulation will be based on an equal weighing of these two factors. 
5. Some Important Points to Consider in Managing Your Task 


|. As the manager of the programming phase, you specify the desired staffing level. You 
may find that your actual staffing level (as it will appear in the reports) is different from what 
you requested. This would be due to factors you cannot control, such as hiring delays and 
turnover. 


2. The staff size you select may have fractions (e.g. 4.5 people). 

3. When requesting additional staff, expect a delay in hiring. For modest additions to your 
staffing, the average hiring delay will be around 40 days. However, if you request a large 
number of additional staff, the average hiring delay will be much longer. 

4. Once new people are hired, they must be trained and assimilated. The 
assimilation/training period is typically 80 days. During this assimilation/training period you 


can expect the new employee to be only half as productive as an experienced employee. 


5. Adding more people increases communication and coordination overhead as happens in 
reality. 
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6. Rules of the Game 


!. You must work alone. At no time are you to discuss the progress of the project with 
anyone. 


2. If you have a question, ask the lab attendant. 


3 You are not allowed to bring any notes or other "gouge" to use during the simulation. Feel 
free to write on the documentation sheets provided. 


4. A calculator is allowed and recommended. 


7. Instructions for Starting the System 


Follow the instructions Carefully. If any problems arise, immediately seek out the lab attendant. 


|. Insert the disk into the B: drive. Do not remove the disk from the drive! 
2. From the C:\ prompt, type B: Do NOT start the network! 
3. Start the simulation by typing START at the B:\ prompt. 


4. Follow the instructions as they appear on the screen. 


5. The simulation is complete when the % Programming Reported Complete in the 
PROJECT STATUS REPORT is 100%. When this occurs Call the lab attendant. 
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Your Name: 
SMC No.:: 


YOUR GOAL IS: 


Minimize total cost incurred and minimize schedule 


overrun. 





INITIAL ESTIMATES: 


Project Size 24400 DSI 
Project Cost 944 Person Days 
Project Duration (start-end) 272 Days 


TIME ELAPSED ESTIMATED ESTIMATED ESTIMATED STAFFING QUALITY 
(DAYS) PRODUCTI- COST DURATION LEVEL - ASSURANC 
(PERS-DAYS) (PERSONS) 


Time Elapsed - 120 Days 
Time Elapsed - 160 Days 
Time Elapsed - 200 Days 


Time Elapsed - 240 Days 


Time Elapsed - 280 Days 


Time Elapsed - 320 Days 
Time Elapsed - 360 Days 
Time Elapsed - 400 Days 
Time Elapsed - 440 Days 
Time Elapsed - 480 Days 


Time Elapsed - 520 Days 
*x** WHEN YOU ARE DONE, CALL THE LAB ATTENDANT *#**# 
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APPENDIX J: B11 INSTRUCTION SET 
Your Name: BI] 
SMC No.:: 


1. Introduction 


The exercise you are about to undertake is similar in many ways to flight simulators that pilots 
use to mimic flying an aircraft from takeoff at point A to landing at point B. Instead of flying an 
aircraft, though, the simulator mimics the programming phase of a real software project. In this 
simulation, you will be more than an observer. In fact, you will play the role of manager of the 
programming phase of the project. Specifically, your role will be to track the progress of the project 
by reviewing Status reports and graphs available every two-month interval (40 working days) during 
the programming phase. As the manager, you must then make two staffing decisions. First, the total 
number of staff you need. (You can hire additional staff, or decrease the staffing level as you deem 
necessary to complete your programming task successfully.) Second, you need to decide on what 
percent of your total staff to allocate to the Quality Assurance activity to be conducted throughout the 
programming phase (e.g. to do inspections). 


2. Project 
The project that you will manage happens to have been a real project conducted in a real 


organization. For the project, you will be given a project profile containing the following initial 
information: 


Estimated Size of the System: in Delivered Source Instructions (DSI) 
Estmated Cost of Programming Phase: in Number of Person Days 

Estimated Duration of Programming Phase: in Number of Work Days 

Size of initial Core Team: in People 


The Core Team is a skeleton staff of software professionals who are there to ensure continuity 
between the requirements/design phase (which you may assume has just been completed), and the 
programming phase you are to manage. 


The cost and schedule estimates are derived from a new off-the-shelf estimation tool, call it 
“NEW_TOOL", that has been recently acquired. 


Historically, the defect density (i.e. number of defects detected during programming divided 
by the number of KDS] developed) has ranged from 5 - 20 Detects/KDSI. 


3. Your task 
Your task at every 40-day interval is to review the project's status, and make any necessary 


adjustments to the staffing level and its allocation. In order to do so, you may feel that is necessary to 
first adjust the project's cost and duration targets. The staffing decision should be done as follows: 
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1. Decide on the total staffing level, and 


2. Decide on what percentage of the staff should be allocated to the quality assurance function 
(i.e. a number between 0 and 100). 


4. Your Goal for the Task: 


Minimize total cost incurred and minimize schedule 


overrun. 





Your grade for the simulation will be based on an equal weighing of these two factors. 
5. Some Important Points to Consider in Managing Your Task 


1. As the manager of the programming phase, you specify the desired staffing level. You 
may find that your actual staffing level (as it will appear in the reports) is different from what 
you requested. This would be due to factors you cannot control, such as hiring delays and 
turnover. 


2. The staff size you select may have fractions (e.g. 4.5 people). 

3, When requesting additional staff, expect a delay in hiring. For modest additions to your 
staffing, the average hiring delay will be around 40 days. However, if you request a large 
number of additional staff, the average hiring delay will be much longer. 

4. Once new people are hired, they must be trained and assimilated. The 
assimilation/training period is typically 80 days. During this assimilation/training period you 


can expect the new employee to be only half as productive as an experienced employee. 


5. Adding more people increases communication and coordination overhead as happens in 
reality. 
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6. Rules of the Game 


1. You must work alone. At no time are you to discuss the progress of the project with 
anyone. 


2. If you have a question, ask the lab attendant. 


3 You are not allowed to bring any notes or other “gouge” to use during the simulation. Feel 
free to write on the documentation sheets provided. 


4. A calculator is allowed and recommended. 
7. Instructions for Starting the System 
Follow the instructions Carefully. If any problems arise, immediately seek out the lab attendant. 
|. Insert the disk into the B: drive. Do not remove the disk from the drive! 
2. From the C:\ prompt, type B: Do NOT start the network! 
3. Start the simulation by typing START at the B:\ prompt. 
4. Follow the instructions as they appear On the screen. 


5. The simulation is complete when the % Programming Reported Complete in the 
PROJECT STATUS REPORT is 100%. When this occurs Call the lab attendant. 


69 


Your Name: 
SMC No.: 


YOUR GOAL IS: 


Minimize total cost incurred and minimize schedule 


overrun. 





INITIAL ESTIMATES: 
Project Size 
Project Cost 

Project Duration (start-end) 


TIME ELAPSED 
(DAYS) 


ESTIMATED 
PRODUCTI- 
VITY 
DSI/P-D 


24400 DSI 
944 Person Days 
272 Days 


ESTIMATED ESTIMATED STAFFING 
COST DURATION LEVEL 
(PERS-DAYS) (DAYS) 


QUALITY 
ASSURANC 
(PERSONS) E 
PERCENT 


fimowcnon tte om 


Time Elapsed - 240 Days 
Time Elapsed - 280 Days 
Time Elapsed - 320 Days 
Time Elapsed - 360 Days 
Time Elapsed - 400 Days 
Time Elapsed - 440 Days 


Time Elapsed - 480 Days 





Time Elapsed - 520 Days 


ke WHEN YOU ARE DONE, CALL THE LAB ATTENDANT #*** 
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APPENDIX K: DESCRIPTION OF THE SIMULATION INTERFACE 
REPORTS AND GRAPHS MENU: 


After every 40-day simulation period, you will immediately get the Reports and Graphs 
Menu shown below. All of the reports and graphs concerning your project's progress are 
available from this menu. You may select any of them by pressing their corresponding number. 


REPORTS AND GRAPHS MENU 


REPORTS : 
PROJEGI STATUS REPORT 


STAPPING REPORT 
DEFECT REPORT 
CUMULATIVE REPORT 


GRAPHS: 
PROJECT PROGRESS GRAPH 


STAPFING GRAPH 

COST AND DURATION GRAPH 

DEFECT STATUS GRAPH 
PRESS £ TO PROCEED TO ENTER DECISIONS FOR THE NEXT 46 DAYS 
Choose an option: Do NOT hit <ENTER> after selectiont!?!); 





After viewing the pertinent information (you may view any report or graph more than 
once), use the "P" selection to proceed to enter your decisions for the next 40 day simulation 
period. 


7 | 


Report 1 (PROJECT STATUS REPORT) A sample report is pictured below: 


2 + mame es: 


POXPPDPIPD DPD DPD PDP >> >> PROJECT STATUS REPORT <<<<<<<h< hh CC CREEK KEK 


AT TIME = 120 DAYS 


INITIAL ESTIMATES (These will not change Chr us eon ee Che saa Cae 


System Size 26, 


Programming Gost 1.468 


Programming Phase Duration Cstart-end> 358 


UPDATED ESTIMATES 
Your Last Est of Programming Phase Cost 1.568 
Your Last Est of Prag Phase Duration (start—-end)> 0 
Time Remaining 


RE On BROenEss 
peepee ced Gomplete 
Total DSI Reported Complete to Bate 
Total Person Days Expended to Date 
Reported Productivity 


PRESS <ENTER> ITO RETURN TO THE MENU 





Person Days 
Days 


Person Days 
Days 
Days 


Percent 
DSI 


Person Days 
DST/Person Day 


This report contains Project Status information as of a particular day in the programming 
phase. The report is divided into 3 sections. The top section shows the INITIAL ESTIMATES 
provided to your customer. This information will not change throughout the project. 

The middle portion is the UPDATED ESTIMATES section. The entries of Your Last Est 
of Programming Phase Cost and Your Last Est of Prog Phase Duration (start-end) would reflect 
any change in cost and duration that you feel you need to make. The Time Remaining is equal_,to 


your current estimate of total duration minus current time. 


The bottom section is the REPORTED PROGRESS section. Remember that this is 
"reported" information and is not guaranteed to be totally accurate, especially early in the phase 
Reported Productivity is simply calculated as Total DSI Reported Complete to Date divided by 


Total Person Days Expended to Date. 


Your Task is complete when the % DSI Reported Complete is 100%. 


u2 


Report 2 (STAFFING LEVEL REPORT) A sample report is pictured below: 


>> DD DDD DDD DODD DD >> D>DD>DDDDD STAPPING REPORT CCCCCCC CER ERR EE CCC EOC 
AT TIME = 86 DAYS 
Gurrent Total Staff Size 1 People 


Staff Allocated to Programming People 
Staff Allocated to QA People 


Percent of Workforce that is Experienced Percent 


PRESS <ENTER> TO RETURN TO THE MENU 





This report contains staffing information as of a particular day in the programming phase. 
The Current Total Staff Size consists of your total staff allocated to both programming activities 
and QA activities. It is the sum of Staff Allocated to Programming and Staff Allocated to QA. 

The Percent of Workforce that is Experienced 1s also shown on this report. This is the 
number of experienced people (i.e. already trained/assimilated) divided by the total staff size 
(which is the sum of experienced and new staff). Once new people are hired, they go through an 
assimilation/training period. This is the time needed to train a new employee in the mechanics of 
the project and bring him/her up to speed. A new employee (i.e. one that is being trained) is only 
half as productive as an experienced employee. 


w 


Report 3 (DEFECT REPORT) A sample report is pictured below: 


>> >> RPP PIDIPD PDD DD DD PD P>DDDD DEFECT REPORT (CCR CKKK CORR CREE CEE 
~~~-CUMULATIUE STATUS FROM START OF PROGRAMMING TO CURRENT DAY => 
TOTAL Defects Detected 5? Defects 
TOTAL KDSI Completed 5.83 KDSI 
Defect Density — 186.1 Defects /KBS]I 


QA Person Days Expended to Date Person Days 


Pregramming Person hi Expended to Date 353 Person Days 
xpe 


OTAL Person Bays 
Tam en nnemeinnmrewewen mm STATISTICS FOR THE LAST 46 DAY PERIOD ONLY 
QA Person Days Expended Last 48 Days LS 


Defects Detected Last 46 Days 22 Defects 
Defect Density Observed Last 480 Days ‘18.3 Defects /KDS! 


nded to Date 393 Person Days 


PRESS <CENTER> TO RETURN TO THE MENU 





This report recaps the TOTAL Person Days Expended to Date and provides a breakdown 
of the number of person days expended on both the QA and programming activities. 

In the top section, this report gives cumulative defect data (1.e. from start of programming 
phase to current time). The bottom section shows data for the last 40 day period only. 

Historically, the Defect Density (i.e. number of defects detected during programming 
divided by the number of KDSI developed) has ranged from 5-20 Defects/KDSI. 

Comparing the aggregate data and the data for the last period can indicate trends. 
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Report 4 (CUMULATIVE REPORT) A sample report is pictured below: 


> >>D>DIIIIDD>DD>I93>> PROJECT CUMULATIVE REPORT <<CCCKKe MRC CREE 
UPDATED ESTIMATES REPORTED PROGRESS 


Cost DURATION “~DSI-COMP PD-EXPENDED PROD 
1.4869 358 3 ?3 17 
1,488 358 16 266 16 
1,586. 356 25 312 16 


PRESS <ENTER> TQ RETURN TO THE MENU 





This report contains Cumulative Project Status information from the start of the project to 
the current period. The report 1s divided into 2 sections. 

The left portion is the UPDATED ESTIMATES section. It reflects cumulative changes in 
the following project estimates: 


COST Your Estimate of Programming Phase Cost (Person Days) . 
DURATION Your Estimate of Prog Phase Duration (start-end) (Days) 


The night portion is the REPORTED PROGRESS section. Remember that this 1s 
"reported" information and 1s not guaranteed to be totally accurate, especially early in the phase. 
It reflects cumulative changes in the following project estimates: 


%DSI-COMP %DSI Reported Complete (Percent) 
PD EXPENDED Total Person Days Expended to Date (Person Days) 
PROD Reported Productivity (DSI/Person Day) 


Your Task 1s complete when the % DSI is 100%. 


1D 


Graph 5 (PROJECT PROGRESS GRAPH) 


- PLANNED ’% COMPLETION RATE 


ema ———'"'A"DST REPORTED” COMPLETED © 


TIME (DAYS) 
Esc 





This graph compares the level of "planned % completion rate" and "%DSI reported complete" 
over time. 
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Graph 6 (STAFFING GRAPH) 


TOTAL STAFF CPERSONS ) —————--————--= PROG STAFF (PERSONS) 
QA STAFF (PERSONS ) 


TIME CDAYS) 
view_no Print Esc 





This graph shows how the level of the total staff, programming staff, and QA staff is changing 
Over time. 


a 


Graph 7 (PROJECT COST AND DURATION GRAPH) 


EST PROGRAMMING PHASE DURATION C(CSTART-END) (6.,446.3 
EST PROGRAMMING COST CPERSON DAYS) (6. ,4008.) 


TIME CDAYS) 


Print Esc 





This graph shows how the estimates of programming phase duration and programming cost are 
changing over time. 
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Graph 8 (DEFECT GRAPH) 


QA PERSON DAYS PER PERIOD 
DEFECTS DETECTED PER PERIOD 


TIME CDAYS) 
Print Esc 





This graph shows how "QA person days expended per period" and the "number of defects 
detected per period" are changing over time. 


oo 
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APPENDIX L. MASTER PROJECT QUESTIONNAIRE 
PROJECT QUESTIONNAIRE XXX 


Your Name: 

SMC No.: 
!. In making your decisions, how much weight out of 100 points did you accord to the 
following goals? (The numbers should total 100 points.) 


Cost [or QUALITY] 


Schedule 
100 


2. Describe (in words, numbers, equation, etc.) what decision rule you followed in 
deciding on the overall staffing level in this project: 


Oo Describe (an words, numbers, equation, etc.) how you allocated staff between 
programming and quality assurance. 


3 | 


Please try to elaborate on the thinking process you went through in making your 
decisions in this project (use back of page if necessary): 


How clear were the instructions regarding the task? 


1 2 3 4 5 6 au 8 9 
Not at all Very 
Clear Clear 


To what extent was the graphical information provided on the progress of the project 
helpful in improving your own decisions? 


] 2 3 4 5 6 7 8 9 
Not at all Very 
Helpful Helpful 


To what extent were the reports on the progress of the project helpful in improving 
your own decisions? 


] 2 3 4 5 6 v 8 9 
Not at all Very 
Helpful Helpful 


In the project that you just completed, did you 
(a) Use the PROJECT STATUS report (Y/N)? 


(b) If you did, please describe how you used the information. 
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In the project that you just completed, did you 
(a) Use the STAFFING LEVEL report (Y/N)? 


(b) If you did, please describe how you used the information. 


In the project that you just completed, did you 
(a) Use the DEFECT report (Y/N)? 


(b) If you did, please describe how you used the information. 


In the project that you just completed, did you 
(a) Use the PROJECT STATUS graph (Y/N)? 


(b) If you did, please describe how you used the information. 
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14. 


In the project that you just completed, did you 
(a) Use the STAFFING LEVEL graph (Y/N)? 


(b) If you did, please describe how you used the information. 


In the project that you just completed, did you 
(a) Use the DEFECT graph (Y/N)? 


(Id) If you did, please describe how you used the information. 


Have you in the past participated in project management (Y/N)? —__ 


If YES, to what extent was the task in this simulation similar to your previous 
experience? 


] 2Z 3 4 5 6 7 8 9 
Not at all Very 
Similar Similar 


How interesting was the task you just performed? 


] Z 3 4 5 6 7 8 9 
Not at all Very 
Interesting Interesting 
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17. 


18. 


19. 


20. 


How serious were you in performing the task? 


| 4 5 6 7, 8 9 
Not at all Very 
Serious Serious 


How clear were the instructions regarding the task, generally? 


1 2 3 4 5 6 7 8 y 
Not at all Very 
Clear Clear 


How easy was the simulation to use? 


I 2 3 4 5 6 r 8 9 
Not at all | Very 
Easy Easy 


Please give us some information about yourself. 


(a) Curriculum enrolled in: 
(b) = Age an 
(c) Sex See 
(d) Full time work experience 

(in years) 


(e) How long ago (in years) did 
you complete your 
undergraduate education? 


a 


(f) How familiar are you with computers, generally? 
| 2 3 4 5 6 u 8 9 
Not at all Very 
Familiar Familiar 
(g) How many hours (per week) do you use computers? 


Your general comments regarding the simulation: 
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*** END OF SIMULATION *** 
Thank you for your participation. 


86 


APPENDIX M: WINDOWS 95 INSTRUCTIONS 


Since this simulation will be used in future experiments on computers running Windows 95, the 
simulation has been upgraded. To use the simulation in Windows 95, the following instructions 
are provided: 


I. A new BAT.COM files has been provided which will work in Windows 95. 


e To operate the simulation in Windows 95, Push F8 when the "starting windows" 
dialogue appears, then select option 8. 


iS Type “start” 
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APPENDIX N. SEATING CHARTS 
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APPENDIX O. KEY TO DATA FILE VARIABLES 


Format explanation of PERFORM.DAT file: 


One line containing 5 identifiers plus 10 variables captured at project completion: 


Name 
SMC 
Project 
Goal 
Order 


FNCOST 
FNTIME 
FNERR 
FNERG 
FNERD 
FNERES 
FNPRDT 
FNQAMD 
FNTRMD 
FNRWMD 


Subject's name 
Student Mail Center Box Number 
A initially underestimated, B initially overestimated 
1 = Cost and Schedule, 2 = Quality and Schedule 
The order that the goals were listed on the instructions (1 or 2) 


Final Cost (in Man Days) 

Final Cumulative Time (Days) 

Final Errors Remaining Undetected 

Final Cumulative Errors Generated 

Final Cumulative Errors Detected 

Final Cumulative Errors Excaping Detection 
Final Percentage of Errors Detected 

Final Cumulative Quality Assurance Man Days 
Final Cumulative Training Man Days 

Final Cumulative Rework Man Days 


9] 


Format explanation of PROCESS.DAT 


One line containing 6 identifiers, 26 output variables, then 5 decision variables captured at 
project start and every 40 workdays until project completion: 


Name 
SMC 
Project 
Goal 
Order 
Day 
IPRJSZ 
TOTMDO 
TDEV 
PJBSZT 
FNERR 
FNERG 
TIMERM 


PRCMPL 
CMDSI 
CUMMD 
RPPROD 
FTEQWF 
CRDVWF 
CRQAWF 


FRWFEX 
CMQAMD 
CMERD 
PRQAMD 
PRERD 
PRDFDS 
PRTKDV 


TOTMDI1 
WES 
CRRWWF 
AFMDPJ 
SCHPR 


PRODTY 
WFS2 

FRMPQI1 
JBSZMD 
SCHCDT 


Subject's name 
Student Mail Center Box Number 
A increased in size, B decreased in Size 
1 = Cost and Schedule, 2 = Quality and Schedule 
The order that the goals were listed on the instructions (1 or 2) 
The period that the decisions were made 
Initial Project Size (in Delivered Source Instructions) 
Programming Phase Cost (in Man Days) 
Programming Phase Duration (Development Time in Days) 
Updated Est of System Size (in DSI) 
Final Errors Remaining Undetected 
Final Cumulative Errors Generated 
Time Remaining 


Percent DSI Reported Complete 

Total DSI Completed to Date 

Total Person Days Expended to Date 
Reported Productivity (in DSI/Person Day) 
Current Total Staff Size (in People) 

Staff Allocated to Programming (in People) 
Staff Allocated to QA (in People) 


Percent of Workforce that is Experienced 
QA Person Days Expended to Date 

Total Defects Detected 

QA Person Days Expended Last 40 Days 
Defects Detected Last 40 Days 

Defect Density Observed Last 40 Days 
DSI Developed Last 40 Days 


Programming Phase Cost (in Man Days) 
Total Workforce Sought 

Current Rework Workforce (in People) 
Actual Fraction of Man Days on Project 
Schedule Pressure 


Estimated programmer productivity 

Total Workforce Requested 

Fraction of Workforce devoted to Quality Assurance (Percent) 
Last Est of Programming Phase Cost (in Person Days) 

Last Est of Prog Phase Duration (start-end in Days) 


D2 


Format explanation of Questionnaire/Demographic Data: 


Qis 
Q1Q 
QIC 

Q5 

Q6 

Q7 

Q8 

Q9 

Q10 
Ql 
Q12 
Q13 
Q14 
Q15 
Q16 
Q17 
Q18 
CURRIC 
AGE 
SEX 
WKEXP 
EDAGO 
CFAM 
CHRSWK 
GRADE 


Question 1 Schedule Percent (All subjects) 
Question I Quality Percent (value only for Goal 2) 
Question 1 Cost Percent (value only for Goal 1) 
Question 5 Response (1-9) 

Question 6 Response (1-9) 

Question 7 Response (1-9) 

Question 8 Response (0/1 1= Yes 0=No) 

Question 9 Response (0/1 1=Yes 0=No)) 
Question 10 Response (0/1 1=Yes 0=No) 
Question 11 Response (0/1 1=Yes 0=No) 
Question 12 Response (0/1 1=Yes 0=No) 
Question 13 Response (0/1 1=Yes 0=No) 
Question 14 Response (0-9 0=No, 1-9 indicate yes and the value) 
Question 15 Response (1-9) 

Question 16 Response (1-9) 

Question 17 Response (1-9) 

Question 18 Response (1-9) 

Curriculum number or abbreviation 

Age (years) 

M= Male, F=Female 

Work Experience (Years) 

Years since undergraduate education was completed 
Computer familiarity (1-9) 

Computer hours per week 

Numeric grade received in IS-4300 course 


3 
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APPENDIX P PROCESS DATA 


Repeated measures on process data. 
09:37 Sunday, March 3, 1996 


OBS GOALS PROJECT LNAME NAME_ _0D00 _120D00 _160D00 _200D00 
—240D00 


ho 
‘© 


Cameron COST 944 1050 1150.0 1848.0 1763.5 
Cepek COST 944 1060 1620.0 1620.0 1440.0 
Chalfant COST 944 1400 1626.0 2440.0 2033.0 
Chaney COST 944 944 944.0 1570.0 2000.0 
Earley COST 944 1000 1632.0 1632.0 1800.0 
Geberth COST 944 938 942.0 950.0 948.0 
Heaton COST 944 2000 2200.0 3200.0 3200.0 
James COST 944 944 944.0 1000.0 2000.0 
coats COST 944 1040 1420.0 2204.0 2077.0 
waller COST 944 944 944.0 944.0 1300.0 


30 
31 
32 
33 
34 
aS 
36 
a7 
38 


in 1 A Asmus COST 944 950 950.0 950.0 950.0 
ae 1 A Stueve COST 944 1000 =1000.0 1000.0 1300.0 
3 1 A gearhard COST 944 944 1200.0 1200.0 1212.0 
4 1 A johnson COST 944 1743 1743.0 1627.0 1627.0 
> 1 A jones COST 944 1500 =1500.0 1000.0 1000.0 
a | A leonard COST 944 944 2200.0 2200.0 2200.0 
yo A norris COST 944 1400 1400.0 1600.0 1850.0 
8 1 A stone COST 944 944 1800.0 1800.0 1800.0 
9 1 A west COST 944 944 944.0 1400.0 1400.0 
10 1 B CELEBI COST 944 900 930.0 940.0 940.0 
li 1 B Cooke COST 944 944 1000.0 1000.0 1000.0 
ee 1 B Jacobson COST 944 994 1340.6 1967.7 1930.0 
Is 1 B brady COST 944 1900 1900.0 620.0 : 
iM 1 B casey COST 944 944 944.0 1500.0 1400.0 
is 1 B flick COST 944 834 794.0 754.0 714.0 
16 61 B gillum COST 944 944 944.0 944.0 944.0 
i el B hague COST 944 944 950.0 1400.0 1500.0 
18 1 B hsing COST 944 900 920.0 940.0 944.0 
19 1 B romano COST 944 944 944.0 944.0 1034.0 
20 2 A Dennis COST 944 1267 1267.0 2018.0 2018.0 
ei 2 A Lankhors COST 944 944 944.0 944.0 944.0 
22 2 A Shaffer COST 944 1000 1400.0 1400.0 2068.0 
za «C2 A TURNER COST 944 2000 2000.0 2200.0 2300.0 
a 2 A king COST 944 944 1000.0 1500.0 1500.0 
25. “2 A kopper COST 944 980 1000.0 1000.0 1200.0 
26, 2 A mihlon COST 944 944 1000.0 1250.0 1300.0 
ZI 2 A ring COST 944 1904 1904.0 2176.0 2720.0 
Ze 2 A staier COST 944 12200 2200.0 2200.0 2200.0 
2 B 
p B 
Z B 
Z B 
2 B 
2 B 
2 B 
2 B 
Z B 
Z B 


2D 


OBS _280D00 _320D00 _360D00 —40D00 80D00 —_400D00 _440D00 —_480D00 


1 950 950 950 944 944 

2 1000 § 1000 

3 ‘ 944 944 

4 1525 : : 1627. = 1743 

5 2000 : 2312 2000 

6 2200 2200 2040 944 944 

i : : 1400 1400 

8 1800 : 944 944 

9 : ‘ ‘ 944 944 

10 940 940 : 940 940 

11 , : ; 944 944 

12 1872 1789 1700 968 984 

13 : : 1000 950 

14 1400 . 944 944 

15 674 : : 944 874 

16 : : 944 944 

17 1500 : 944 944 

18 944 : 900 900 

19 1400 1500 ‘ 944 944 

20 2018 ; 1267 =1267 

21 944 944 944 944 944 

22 ; : : 944 1000 

23 2300 2300 : 1200 =1200 

24 : : , 944 944 

25 ‘ : 950 950 

26 : : ; 944 944 

21 @2720 2720 . 1150 1904 

28 : : . 1888 2000 

29 . 1054 —s- 1073 

30 2218 2218 - 1017 = 1060 

31 =: 1931 3 ; 944 1572 

32 ©1950 ; 944 944 

33-2300 2300 2300 944 1000 

34 =1100 1300 : 940 940 

35 =. 3200 1632 2400 ; 

36 =. 2000 3000 3000 944 944 3000 3000 3000 

37 =. 2018 1913 s 1016 ~=—1120 

38 = 1400 2000 2300 944 944 ; : 
Repeated measures on process data. 8 


09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Class Level Information 
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Class Levels Values 
GOALS 2 ae 


PROJECT 2 AB 


Number of observations in data set = 38 


Repeated measures on process data. 9 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Repeated Measures Level Information 


Dependent Variable _0D00 _40D00 _80D00 120D00 160D00 _200D00 


Level of PERIOD 1 2 3 4 5 6 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD Effect 
H = Type III SS&CP Matrix for PERIOD E = Error SS&CP Matrix 


S=1 Me=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr > F 
Wilks' Lambda 0.43330173 8.1087 5 31 0.0001 
Pillai's Trace 0.56669827 8.1087 5 31 0.0001 


Hotelling-Lawley Trace  1.30786062 8.1087 5 31 0.0001 
Roy's Greatest Root 1.30786062 8.1087 5 31 0.0001 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD*GOALS 
Effect 
H = Type III SS&CP Matrix for PERIOD*GOALS_ E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr>F 
Wilks' Lambda 0.78079533 1.7406 5 31 0.1547 
Pillai's Trace 0.21920467 1.7406 5 31 0.1547 
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Hotelling-Lawley Trace 0.28074536 1.7406 5 31 0.1547 
Roy's Greatest Root 0.28074536 1.7406 5 31 0.1547 


Manova Test Criteria and Exact F Statistics for 
the Hypothesis of no PERIOD*PROJECT Effect 
H = Type ITI SS&CP Matrix for PERIOD*PROJECT E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.85616720 1.0416 5 31 0.4111 
Pillai's Trace 0.14383280 1.0416 5 31 0.4111 


Hotelling-Lawley Trace 0.16799616 1.0416 3 31 0.4111 
Roy's Greatest Root 0.16799616 1.0416 5 31 0.4111 
Repeated measures on process data. 10 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Tests of Hypotheses for Between Subjects Effects 


Source DF Type III SS Mean Square F Value Pr > F 
GOALS 1 1256636.72320175 1256636.72320175 2.70 0.1092 
PROJECT 1 1098499.45669055 1098499.45669055 2.36 0.1333 
Error 35. 16277870.78734450  465082.02249556 

Repeated measures on process data. 11 


09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Univariate Tests of Hypotheses for Within Subject Effects 


Source: PERIOD 
Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 6366921.41853 1273384.28371 17.11 0.0001 0.0001 0.0001 


Source: PERIOD*GOALS 


Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
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5 1200514.33075 240102.86615 3.23 0.0082 0.0278 0.0214 


Source; PERIOD*PROJECT 


Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 280382.78520 56076.55704 0.75 0.5845 0.5166 0.5344 


Source: Error(PERIOD) 


DF Type III SS Mean Square 
175 13021182.31287 74406.75607 


Greenhouse-Geisser Epsilon = 0.5704 
Huynh-Feldt Epsilon = 0.6618 


Repeated measures on process data. 12 
09:37 Sunday, March 3, 1996 


Variable N Mean Std Dev Minimum 
_0D00 9 944.0000000 0 944.0000000 944.0000000 
_40D00 9 1228.78 476.8515958 944.0000000 2312.00 
_80D00 9 1207.00 409.5863767 944.0000000 2000.00 
_120D00 9 1152.11 310.0106629 944.0000000 1743.00 
_160D00 9 1415.22 438.1779826 944.0000000 2200.00 
_200D00 9 1419.67 425.8151007 950.0000000 2200.00 


Maximum 


Variable N Mean Std Dev Minimum 
_0D00 10 944.0000000 0 944.0000000 944.0000000 
_40D00 10 947.2000000 24.8587119 900.0000000 1000.00 
_80D00 10 936.8000000 29.7575387 874.0000000 984.0000000 
_120D00 10 1024.80 310.3978809 834.0000000 1900.00 
_160D00 10 1066.66 324.4168793 794.0000000 1900.00 
_200D00 10 1100.97 403.1655134 620.0000000 1967.70 


Maximum 
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Variable 


120D00 


_160D00 10 1342.20 428.9993007 942.0000000 2200.00 
_200D00 10 1740.80 723.3282335 944.0000000 3200.00 


OBS GOALS 
_240D00 


hems pommh«pmumh~«spmmh«smmmh_—«smmh_—«smmh,« smn, «pm, PDP ements fmm pec peek fe 


WWW WWW Wr rr err Pr er PP 


N Mean Std Dev Minimum Maximum 
9 944.0000000 0 944.0000000 944.0000000 
9 1136.78 310.0410367 944.0000000 1888.00 
9 1239.22 422.1030022 944.0000000 2000.00 
9 1353.67 525.9030329 944.0000000 2200.00 
9 1412.78 494.7438170 944.0000000 2200.00 
9 1632.00 522.0296926 944.0000000 2200.00 


N Mean Std Dev Minimum Maximum 
10 944.0000000 Q 944.0000000 944.0000000 

10 1037.90 212.8643021 940.0000000 1632.00 
10 1199.70 462.4476066 940.0000000 2400.00 
10 1132.00 334.4501292 938.0000000 2000.00 


Repeated measures on process data. 19 
09:37 Sunday, March 3, 1996 


PROJECT LNAME _NAME_ 0D00 120D00 160D00 200D00 


Asmus DURATION 272 250.0 250.0 260.0 280.0 
Stueve DURATION 272 300.0 300.0 300.0 300.0 
gearhard DURATION 272 272.0 272.0 272.0 280.0 
johnson DURATION 272 349.0 349.0 271.0 271.0 
jones DURATION 272 272.0 272.0 272.0 300.0 
leonard DURATION 272 272.0 272.0 272.0 302.0 
norris DURATION 272 272.0 272.0 272.0 272.0 
stone DURATION 272 272.0 272.0 272.0 300.0 
west DURATION 272 272.0 272.0 272.0 272.0 
CELEBI DURATION 272 272.0 272.0 272.0 272.0 
Cooke DURATION 272 272.0 272.0 280.0 280.0 
Jacobson DURATION 272 261.6 343.7 491.9 378.4 
brady DURATION 272 250.0 300.0 300.0 é 
casey DURATION 272 250.0 272.0 360.0 320.0 
flick DURATION 272 152.0 112.0 72.0 32.0 
gillum DURATION 272 272.0 272.0 272.0 272.0 
hague DURATION 272 272.0 238.0 300.0 285.0 
hsing DURATION 272 270.0 272.0 276.0 276.0 
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9 1 B 
202 =«2A 
212 #2A 
22a aA 
232 &«2A 
242 #«2A 
25a 
26 2 #2A 
27 wane mh 
2392 A 
29 2 = =&B 
30 2 B 
a2 6B 
3222 =&B 
332 = «#=&B 
342 B 
35 2 B 
36 2 «OB 
372 ~=«2O«#WB 
58 B 
OBS _280D00 
1 290.0 
2 

aa. 

4 254.0 

5 300.0 

6 302.0 
Ja 

8 300.0 
9, 

10 272.0 
i] 

12 340.5 
3, 

14 320.0 
15 12.0 
ig... 

17 285.0 
18 276.0 
19 272.0 
20 290.0 
pie 72.0 
el 

23 350.0 


360 


302 


272 


313 


290 
Pes 


350 


romano DURATION 272 272.0 272.0 272.0 272.0 
Dennis DURATION 272 272.0 272.0 272.0 272.0 
Lankhors DURATION 272 272.0 272.0 272.0 272.0 
Shaffer DURATION 272 300.0 400.0 400.0 272.0 
TURNER DURATION 272 272.0 272.0 400.0 400.0 
king DURATION 272 272.0 272.0 272.0 255.0 
kopper DURATION 272 272.0 280.0 280.0 280.0 
mihlon DURATION 272 272.0 272.0 272.0 272.0 
ring DURATION 272 272.0 272.0 272.0 280.0 
staier DURATION 272 280.0 272.0 272.0 260.0 
Cameron DURATION 272 272.0 272.0 314.0 315.0 
Cepek DURATION 272 271.0 406.0 280.0 280.0 
Chalfant DURATION 272 292.0 313.0 406.0 359.0 
Chaney DURATION 272 272.0 272.0 272.0 272.0 
Earley DURATION 272 272.0 272.0 272.0 300.0 
Geberth DURATION 272 268.0 270.0 278.0 275.0 
Heaton DURATION 272 300.0 320.0 320.0 320.0 
James DURATION 272 272.0 300.0 300.0 325.0 
coats DURATION 272 273.0 348.0 680.0 405.0 
waller DURATION 272 272.0 272.0 272.0 300.0 
_320D00 _360D00 —40D00 —80D00 —400D00 440D00 —_480D00 
272.0 272.0 
300.0 300.0 
272.0 272.0 

407.0 436.0 

272.0 272.0 

272.0 272.0 
272.0 272.0 

272.0 272.0 
272.0 272.0 

270.0 272.0 
272.0 272.0 

242.0 246.0 
400.0 320.0 

272.0 272.0 

272.0 192.0 
272.0 272.0 

272.0 272.0 

272.0 272.0 

272.0 272.0 

272.0 272.0 

272.0 272.0 
272.0 300.0 

272.0 272.0 


360 


302 


298 


272 
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24 —(«w : : 272.0 272.0 


25 ae . ; 272.0 272.0 
26 —=Ctir : : Zee = =6—°272.0 
27 290.0 294 ‘ 272-0 eZ 72.0 
25 ; 272.0 280.0 
29-0 ‘ ; 310.1 233.7 
30 320.0 360 } 282.0 151.0 
31 320.0 : 4 272.0 262.0 
32 290.0 ‘ : 272.0 272.0 
33 360.0 360 375 272.0 272.0 
34 275.0 360 ‘ 270.0 268.0 
35 320.0 : J 272.0 300.0 ; : : 
36 360.0 500 500 272.0 272.0 500 500 500 
37 5377.0 348 ‘ 210.0 226.0 
38 320.0 440 400 272.0 272.0 
Repeated measures on process data. 20 


09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Class Level Information 


Class Levels Values 
GOALS 2 12 


PROJECT 2 AB 


Number of observations in data set = 38 


Repeated measures on process data. 21 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Repeated Measures Level Information 


Dependent Variable 0D00 40D00 80D00 120D00 160D00 200D00 


Level of PERIOD ] 2 3 4 5 6 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD Effect 
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H = Type III SS&CP Matrix for PERIOD E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr > F 
Wilks' Lambda 0.74468985 2.1256 5 31 0.0886 
Pillai's Trace 0.25531015 2.1256 5 31 0.0886 


Hotelling-Lawley Trace 0.34284092 2.1256 5 31 0.0886 
Roy's Greatest Root 0.34284092 2.1256 5 31 0.0886 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD*GOALS 
Effect 
H = Type III SS&CP Matrix for PERIOD*GOALS_ E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.80359118 1.5154 5 31 0.2137 
Pillai's Trace 0.19640882 1.5154 5 31 0.2137 


Hotelling-Lawley Trace 0.24441385 1.5154 5 31 0.2137 
Roy's Greatest Root 0.24441385 1.5154 5 31 0.2137 


Manova Test Criteria and Exact F Statistics for 
the Hypothesis of no PERIOD*PROJECT Effect 
H = Type III SS&CP Matrix for PERIOD*PROJECT E = Error SS&CP Matrix 
S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr>F 


Wilks' Lambda 0.79561946 1.5927 5 31 0.1914 
Pillai's Trace 0.20438054 1.5927 5 31 0.1914 


Hotelling-Lawley Trace 0.25688227 1.5927 5 31 0.1914 
Roy's Greatest Root 0.25688227 1.5927 5 31 0.1914 
Repeated measures on process data. Ze 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Tests of Hypotheses for Between Subjects Effects 
Source DF Type III SS Mean Square F Value Pr > F 


GOALS ] 3011.30684211 3011.30684211 0.74 0.3955 
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PROJECT 1 45900394737 459.00394737 0.11 0.7390 


Error 35 142429.73149123 4069.42089975 


Repeated measures on process data. 23 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Univariate Tests of Hypotheses for Within Subject Effects 


Source: PERIOD 
Adj Pr >F 
DF Type III SS Mean Square F Value Pr >F G-G H-F 
5 24567.3865673 4913.4773135 2.81 0.0181 0.0766 0.0708 


Source: PERIOD*GOALS 
Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 22529.6868421 4505.9373684 2.58 0.0281 0.0928 0.0870 


Source: PERIOD*PROJECT 
Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 14332.2602515 2866.4520503 1.64 0.1519 0.2056 0.2033 


Source: Error(PERIOD) 


DF Type III SS Mean Square 
175 305974.6190468 1748.4263946 


Greenhouse-Geisser Epsilon = 0.3394 
Huynh-Feldt Epsilon = 0.3753 


Repeated measures on process data. 24 
09:37 Sunday, March 3, 1996 


Variable N Mean Std Dev Minimum Maximum 


_0D00 = 9 272.0000000 0 272.0000000 272.0000000 
40D00 9 290.1111111 44.8007936 272.0000000 407.0000000 
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_80D00 = =9 =293.3333333 54.2954878 
_120D00 9 281.2222222 28.3539141 
_160D00 9 281.2222222 28.3539141 250.0000000 349.0000000 
_200D00 9 273.6666667 10.6301458 260.0000000 300.0000000 


272.0000000 436.0000000 
250.0000000 349.0000000 


Variable N Mean Std Dev Minimum Maximum 
_0D00 = 10 272.0000000 0 272.0000000 272.0000000 

_40D00 10 281.6000000 42.6437438 242.0000000 400.0000000 
_80D00 10 266.2000000 31.6992814 192.0000000 320.0000000 
_120D00 10 254.3600000 37.0711988 152.0000000 272.0000000 
_160D00 10 262.5700000 59.4340353 112.0000000 343.7000000 
_200D00 10 289.5900000 102.5529289 72.0000000 491.9000000 


Variable N Mean Std Dev Minimum Maximum 
_0D00 9 272.0000000 0 272.0000000 272.0000000 

40D00 9 272.0000000 0 272.0000000 272.0000000 

_80D00 9 276.0000000 9.3808315 272.0000000 300.0000000 
_120D00 9 276.0000000 9.3808315 272.0000000 300.0000000 
_160D00 9 287.1111111 42.4159299 272.0000000 400.0000000 
_200D00 9 = 301.3333333 56.0000000 272.0000000 400.0000000 


Mean Std Dev Minimum 
_0D00 = 10 272.0000000 0 272.0000000 272.0000000 

40D00 10 270.4100000 24.4366051 210.0000000 310.1000000 
_80D00 10 252.8700000 41.4518744 151.0000000 300.0000000 
_120D00 10 276.4000000 10.5851048 268.0000000 300.0000000 
_160D00 10 304.5000000 44.6498725 270.0000000 406.0000000 
_200D00 10 339.4000000 126.4666842 272.0000000 680.0000000 


Maximum 


Repeated measures on process data. 


1 
09:37 Sunday, March 3, 1996 
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OBS GOALS PROJECT LNAME —NAME_ 0D00 _120D00 _160D00 _200D00 
_240D00 


ial A Asmus PROD 0 18.00 20.00 20.00 20.00 

2a A Stueve PROD 0 20.00 20.00 20.00 20.00 

Sad A gearhard PROD 0 18.35 19.30 20.40 20.60 

4 1 A johnson PROD 0 14.00 14.00 15.00 15.00 

5 al A jones PROD 0 9.00 9.00 15.00 15.00 

6 1 A leonard PROD 0 10.00 9.00 10.00 10.00 

al A norris PROD 0 15.00 18.00 15.00 15.00 

8 1 A stone PROD 0 14.00 14.00 16.00 16.00 

9 1 A west PROD 0 16.00 17.00 19.00 19.00 
10 #1 B CELEBI PROD 0 -— 27.00 25.00 20.00 26.00 
ll 1 B Cooke PROD 0 28.00 28.00 28.00 28.00 
127 B Jacobson PROD 0 24.50 18.20 12.40 12.64 
I3 1 B brady PROD 0 25.00 25.00 15.00 : 
14 1 B casey PROD 0 26.50 5.50 20.00 20.00 
Is 1 B flick PROD 0 30.00 50.00 100.00 100.00 
16 = 1 B gilum PROD 0 26.00 20.00 16.00 18.00 
oe B hague PROD 0 26.00 19.00 16.00 16.00 
18 | B hsing PROD 0 28.00 28.00 20.00 20.00 
19 I B romano PROD 0 26.00 13.00 20.00 30.00 
20 2 A Dennis PROD 0 13.00 13.00 12.00 13.00 
ila 2 A Lankhors PROD 0 12.00 12.00 14.00 16.00 
22 2 A Shaffer PROD 0 12.00 12.00 15.00 26.00 
250 2 A TURNER PROD 0 9.00 9.00 9.00 10.00 
24 2 A king PROD 0 13.00 20.00 20.00 20.00 
Zor 2 A kopper PROD 0 13.00 15.00 15.50 17.00 
26 2 A mihlon PROD 0 20.00 20.00 20.00 20.00 
an 2 A ring PROD 0 13.00 13.00 12.00 12.00 
28 2 A staier PROD 0 8.94 11.71 13.89 15.17 
29 2 B Cameron PROD 0 29.00 = 18.00 13.00 14.00 
30 2 B Cepek PROD 0 23.00 23.00 23.00 9.00 
See B Chalfant PROD 0 15.00 15.00 10.00 12.00 
S22 B Chaney PROD 0 25.40 20.00 15.00 15.00 
S35 B Earley PROD 0 24.00 15.00 15.00 10.00 
34 2 B Geberth PROD 0 27.00 24.00 12.00 13.00 
35° 6 2 B Heaton PROD 0 13.00 13.00 11.00 11.00 
36 2 ‘B James PROD 0 25.56 = 15.68 6.54 7.54 
an ee, B coats PROD 0 = 22.00 = 17.00 11.00 12.00 
380 2 B waller PROD 0 26.00 26.00 15.00 15.00 


OBS 280D00 320D00 360D00 40D00 80D00 400D00 440D00 480D00 


= 


20.00 22.00 22.00 16.00 16.00 
2 : ; : 20.00 20.00 
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: : : 18.32 17.89 
16.00 ‘ ; 15.00 14.00 


15.00 : : 10.00 10.00 
11.00 12.00 12.00 11.00 8.00 
: : : 15.00 15.00 
16.00 : : 10.00 14.00 
: : : 16.00 16.00 ; 
26.00 26.00 25.00 26.00 
; ; L 28.00 28.00 : 
13.03 13.64 14.30 25.20 24.80 
: 24.00 24.00 
20.50 25.00 25.00 
100.00 25.00 50.00 
: 25.00 25.00 
16.00 26.00 26.00 
20.00 : 25.00 28.00 
30.00 25.00 26.00 26.00 
14.00 ; : 18.00 15.00 
16.00 16.00 16.00 12.00 12.00 
' ; 17.00 12.00 
11.00 11.00 . 11.00 10.00 
26.00 26.00 
16.00 14.00 
: : : 18.00 20.00 : 
12.00 12.00 : 18.00 18.00 
10.80 7.07 
; : : 23.14 22.70 
11.00 11.00 24.00 24.00 
13.00 25.00 25.00 
15.00 : : 25.00 25.40 
15.00 15.00 12.00 25.00 24.40 
13.00 15.00 27.00 27.00 
11.00 ; ’ 16.00 12.00 ; : 
8.00 8.73 9.34 25.00 25.38 9.99 10.42 10.37 
12.00 13.00 : 25.00 25.00 
15.00 15.00 15.00 25.00 25.00 
Repeated measures on process data. Z 


09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Class Level Information 
Class Levels Values 


GOALS 2 12 
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PROJECT 2 AB 


Number of observations in data set = 38 


Repeated measures on process data. 3 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Repeated Measures Level Information 


Dependent Variable _0D00 _40D00 _80D00 120D00 160D00 200D00 


Level of PERIOD 1 Zz 3 4 5 6 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD Effect 
H = Type HI SS&CP Matrix for PERIOD E = Error SS&CP Matrix 


S=1 M=1.5 N=14,5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.01900105 320.0978 5 31 0.0001 
Pillai's Trace 0.98099895 320.0978 5 31 0.0001 


Hotelling-Lawley Trace 51.62867719 320.0978 5 31 0.0001 
Roy's Greatest Root 51.62867719 320.0978 5 31 0.0001 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD*GOALS 
Effect 
H = Type IIT SS&CP Matrix for PERIOD*GOALS_ E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.73634416 2.2200 5 31 0.0773 
Pillai's Trace 0.26365584 2.2200 5 31 0.0773 


Hotelling-Lawley Trace 0.35806062 2.2200 5 31 0.0773 
Roy's Greatest Root 0.35806062 2.2200 5 31 0.0773 


Manova Test Criteria and Exact F Statistics for 
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the Hypothesis of no PERIOD*PROJECT Effect 
H = Type III SS&CP Matrix for PERIOD*PROJECT E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr > F 
Wilks' Lambda 0.24104698 19.5211 5 31 0.0001 
Pillai's Trace 0.75895302 19.5211 5 31 0.0001 


Hotelling-Lawley Trace 3.14856880 19.5211 5 31 0.0001 
Roy's Greatest Root 3.14856880 19.5211 5 31 0.0001 
Repeated measures on process data. 4 
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General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Tests of Hypotheses for Between Subjects Effects 


Source DF Type III SS Mean Square F Value Pr > F 
GOALS 1 433.12746711 433.12746711 3.31 0.0776 
PROJECT 1 2780.84385965 2780.84385965 21.23 0.0001 
Error 35 4585.27692456 131.00791213 

Repeated measures on process data. 2 


09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Univariate Tests of Hypotheses for Within Subject Effects 


Source: PERIOD 
Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 11710.55586480 2342.11117296 69.37 0.0001 0.0001 0.0001 


Source: PERIOD*GOALS 
Adj Pr >F 


DF Type III SS Mean Square F Value Pr >F G-G H-F 
5 428.81399342 85.76279868 2.54 0.0301 0.1046 0.1001 


Source: PERIOD*PROJECT 
Adj Pr > F 
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DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 913.25745427 182.65149085 5.41 0.0001 0.0142 0.0119 


Source: Error(PERIOD) 


DF Type III SS Mean Square 
175 5908.81074047 33.76463280 


Greenhouse-Geisser Epsilon = 0.2872 
Huynh-Feldt Epsilon = 0.3133 


Repeated measures on process data. 6 
09:37 Sunday, March 3, 1996 


Variable N Mean Std Dev Minimum Maximum 
_0D00 9 0 0 0 0 

40D00 9 14.5911111 3.5797641 10.0000000 20.0000000 
80D00 = 9 = 14.5433333 3.6992432 8.0000000 20.0000000 
_120D00 9 14.9277778  3.6941771  9.0000000 20.0000000 
_160D00 9 = 15.5888889  4.3641850 9.0000000 20.0000000 
_200D00 9 16.7111111 3.4425443 10.0000000 20.4000000 


SP2@@S FZ FS VZF SF 8 TS 2 T 2 FF e8 SCP TF TS 2S S88 OFF FF SS SS TT SSF SSF FS OF FF Oe SS Sr SF ee ZF OF oO See 


Variable N Mean Std Dev Minimum Maximum 


-0D00 10 0 0 0 0 

-40D00 10 25.4200000 1.0685400 24.0000000 28.0000000 
~80D00 10 28.2800000 7.7420640 24.0000000 50.0000000 
-120D00 10 26.7000000 1.6193277 24.5000000 30.0000000 
-160D00 10 23.1700000 11.7426147 5.5000000 50.0000000 
-200D00 10 26.7400000 26.0863608 12.4000000 100.0000000 


222 2€@€8 @2e@F2 22 TC SS SC SG SS@ FSS S222 Sl @F 22 © SS SSE SEG = HS SSSSSSSFTF TZ TSF F SSH Se FTF FFF 88 


Variable N Mean Std Dev Minimum Maximum 
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NWO 


COOrnNIANAMN & WN = 
Te i en le 


_40D00 
~80D00 
-120D00 


16.3111111 
14.8966667 
12.6600000 
_160D00 13.9677778  3.7622260 9.0000000 
_200D00 14.5988889  3.6234322 9.0000000 


4.7456413 
5.7204545 
3.2102025 


10.8000000 
7.0700000 
8.9400000 


-0D00 
-40D00 10 
80D00 10 
~120D00 10 
-160D00 10 18.6680000  4.3959598 —13.0000000 
-200D00 10 13.1540000 4.3651962 —_6.5400000 


Repeated measures on process data. 


24.0140000 
23.5880000 
22.9960000 


2.9765312 
4.2165937 
5. 1565863 


16.0000000 
12.0000000 
13.0000000 


26.0000000 
26.0000000 
20.0000000 
20.0000000 
20.0000000 


Maximum 


27.0000000 
27.0000000 
29.0000000 
26.0000000 
23.0000000 
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09:37 Sunday, March 3, 1996 


0000000 0 


Asmus 
Stueve QC 5.0 2 2 2 2 
gearhard QC 0.5 1 1 10 20 
johnson QC 10.0 10 10 10 10 10 
jones QC 25.0 30 30 30 20 15 


2Oae2 


norris QC 10.0 20 20 25 15 
stone QC 23.0 10 10 7 7 5 
west QC 10.0 10 10 10 10 
CELEBI 


Cooke 


QC 10.0 10 10 10 10 10 10 
Qc 10.0 5 2 2 2 . 10.0 5 
brady QC 15.0 10 10 10 . . 
casey QC 10.0 10 10 10 10 10 
flick QC 20.0 30 30 20 10 10 


gilum QC 15.0 10 10 10 10 


mir mit wm Or rr er Pr PP PP 


femme fem eee eet 


Pel 


0.5 1 

- 10.0 10 
. 25.0 30 . 
leonard QC 25.0 25 25 25 25 25 20 20 25.0 25 
. 15.0 20 
. 20.0 15 
. 10.0 10 . . 
. 10.0 10 


000 0 0 


OC MNS. 05175 6222. 2 Sees 


Jacobson QC 20.0 13 15 15 15 15 10 10 20.0 15 
. 15.0 10 
- 10.0 10 
. 20.0 20 
- 10.0 10 


17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
JS 
36 


38 


NNNNNNNNNNN NN NNW WN WN NN = = = 


WWW nmmWnmnannnwnrrerrrrrvrvr rer Paae 


hague QC 15.0 15 10 10 10 10 . . 15.0 15 


hsing QC 13.0 13 10 10 10 10 . . 13.0 12 
romano QC 15.0 15 10 10 10 10 20 . 15.0 15 
Dennis QC 15.0 14 14 12 12 8 . . 15.0 15 
Lankhors QC 20.0 20 20 20 20 20 20 20 20.0 20 
Shaffer QC 20.0 15 25 30 35 .. . 20015 . 
TURNER QC 15.0 23 23 23 20 25 15 . 18.0 21 
king QC 15.0 10 15 15 18 . . . 17.0 17 
kopper QC 10.0 10 10 8 5... . 15.0 12 
mihlon QC 10.0 5432... 80 6. 
ring QC 15.0 20 21 20 11 13 9 . 17.0 20 
staier QC 20.0 10 15 20 25. . . 20.015 . 
Cameron QC 10.0 20 10 10 10 . . . 10.0 20 . 
Cepek QC 20.0 40 30 30 40 40 40 . 30.0 40 
Chalfant QC 25.0 25 15 15 15 15 . . 25.0 25 
Chaney QC 15.0 25 25 20 20 20 . . 20.0 20 


Earley QC 20.0 25 25 25 25 20 20 25 20.0 25 . 

Geberth QC 15.0 20 20 20 20 20 20 . 15.0 20 

Heaton QC 15.0 18 18 18 20 20 . . 18.0 18 . 

James QC 50.0 55 40 40 40 30 30 25 50.0 50 20 25 40 

coats QC 15.0 25 20 20 20 20 20 . 15.0 20 

waller QC 30.0 80 30 50 40 20 20 30 30.0 60 

Repeated measures on process data. 26 
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General Linear Models Procedure 
Class Level Information 


Class Levels Values 
GOALS 2 ie 


PROJECT 2 AB 


Number of observations in data set = 38 


Repeated measures on process data. 74) 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 


Repeated Measures Analysis of Variance 
Repeated Measures Level Information 


V2 


Dependent Variable _0D00 40D00 80D00 120D00 160D00 200D00 


Level of PERIOD I 2 3 4 3 6 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD Effect 
H = Type III SS&CP Matrix for PERIOD E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr>F 
Wilks' Lambda 0.83872781 1.1921 5 31 0.3358 
Pillai's Trace 0.16127219 1.1921 5 31 0.3358 


Hotelling-Lawley Trace 0.19228192 1.1921 5 31 0.3358 
Roy's Greatest Root 0.19228192 1.1921 5 31 0.3358 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD*GOALS 
Effect 
H = Type III SS&CP Matrix for PERIOD*GOALS_E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.81500205 1.4073 5 31 0.2490 
Pillai's Trace 0.18499795 1.4073 5 31 0.2490 


Hotelling-Lawley Trace  0.22699077 1.4073 5 31 0.2490 
Roy's Greatest Root 0.22699077 1.4073 5 31 0.2490 


Manova Test Criteria and Exact F Statistics for 
the Hypothesis of no PERIOD*PROJECT Effect 
H = Type III SS&CP Matrix for PERIOD*PROJECT E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.72838370 2.3120 5 31 0.0677 
Pillai's Trace 0.27161630 2.3120 5 31 0.0677 


Hotelling-Lawley Trace 0.37290277 2.3120 5 31 0.0677 
Roy's Greatest Root 0.37290277 = =2.3120 = 31 0.0677 
Repeated measures on process data. 28 
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General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Tests of Hypotheses for Between Subjects Effects 


Source DF Type III SS Mean Square F Value Pr > F 
GOALS I 3793.42105263 3793.42105263 8.35 0.0066 
PROJECT ] 1229.06842105 1229.06842105 2.71 0.1089 
Error 35 15891.54561404 454.04416040 

Repeated measures on process data. 29 


09:37 Sunday, March 3, 1996 
General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Univariate Tests of Hypotheses for Within Subject Effects 


Source: PERIOD 


Adj Pr >F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 190.16140351 38.03228070 1.80 0.1153 0.1694 0.1634 
Source: PERIOD*#GOALS 
Adj Pr > F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 
5 258.72368421 51.74473684 2.45 0.0357 0.0888 0.0810 
Source: PERIOD*PROJECT 
Adj Pr>F 
DF Type III SS Mean Square F Value Pr>F G-G H-F 


5 334.74035088 66.94807018 3.17 0.0092 0.0438 0.0374 
Source: Error(PERIOD) 


DF Type III SS Mean Square 
175 3698.59298246 21.13481704 


Greenhouse-Geisser Epsilon = 0.4341 
Huynh-Feldt Epsilon = 0.4903 


Repeated measures on process data. 30 
09:37 Sunday, March 3, 1996 
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Std Dev 


eS 


Minimum Maximum 
_0D00 9 13.7222222 §8.9061464 0.5000000 25.0000000 
40D00 9 13.6111111 8.9225059 0.5000000 25.0000000 
80D00 9 = 14.2222222 9.7439440 1.0000000 30.0000000 
-120D00 9 = 13.3333333 9.8361578  1.0000000 30.0000000 
_160D00 9 = 12.5555556 10.2238827 1.0000000 30.0000000 
_200D00 9 13.4444444 10.4894127 2.0000000 30.0000000 
wa nnn = none nnn nn noe == === === === GOALS =I1 PROJECT =B ---------------------------------- 
Variable N Mean Std Dev Minimum Maximum 
_0D00 10 = 14.3000000 = 3.7133393 =10.0000000 20.0000000 
40D00 10 13.8000000 3.9384148 10.0000000 20.0000000 
_80D00 10 12.2000000  4.1579910  5.0000000 20.0000000 
_120D00 10 = 13.1000000 6.6407831  5.0000000 30.0000000 
_160D00 10 11.7000000 7.1499806  2.0000000 30.0000000 
_200D00 10 10.7000000 4.5227818 2.0000000 20.0000000 
a-------------22---- 2-2 --- === === == GOALS =2 PROJECT =A ---------------------------------- 
Variable N Mean Std Dev Minimum Maximum 
_0D00 9 15.5555556 3.9086798 10.0000000 20.0000000 
40D00 9 16.6666667 3.8078866  8.0000000 20.0000000 
_80D00 9 15.6666667 4.6904158  6.0000000 21.0000000 
_120D00 9 14.1111111 5.9465209 5.0000000 23.0000000 
_160D00 9 = 16.3333333 6.6708320  4.0000000 25.0000000 
_200D00 9 16.7777778  8.1972218  3.0000000 30.0000000 
no 2nn--2---- 222-22 ----- 5 ------ == GOALS =2 PROJECT =B ---------------------------------- 
Variable N Mean Std Dev Minimum Maximum 
_0D00 = 10 21.5000000 11.5590273 10.0000000 50.0000000 
40D00 10 23.3000000 11.4022415 10.0000000 50.0000000 


_80D00 10 29.8000000 14.8832493 18.0000000 60.0000000 
_120D00 10 33.3000000 19.8888579  18.0000000 80.0000000 
_160D00 10 23.3000000  8.6287633 10.0000000 40.0000000 
_200D00 10 24.8000000 12.1271046 10.0000000 50.0000000 
Repeated measures on process data. 13 

09:37 Sunday, March 3, 1996 


P 

R a Ieee 2en2 Se 3mm 4rd 

GOL N 260 4 8 2 6 4 8048 

OJN A 000000 0 0 0 0000 
OAEA M D DODD D iD iD D&D OD OD$ODODODD 
BLCM E 000000 0 0 0 0000 
SSTE 0000 0 0 0 0 0 0000 
11AAsmus_ STAFF 3.5 3.5 3.5 3.0 3.0 3.0 2.9 2.9 3.5 3.5... 
21A Stueve STAFF 5.0 5.0 5.0 5.05.0 . . . 405.0... 
31A gearhard STAFF 5.2 5.2 5.2 5.0 3.6 . . . 5.2 5.2... 
41A johnson STAFF 4.0 6.0 6.0 6.0 6.0 6.0 . . 4.0 6.0... 
51Ajones STAFF 5.0 8.0 8.010.010.0 7.00 . . 6.0 6.0... 
61A leonard STAFF 4.0 7.0 7.0 7.0 7.0 7.0 7.0 7.0 4.0 7.0... 
71 Anorris STAFF 6.5 9.0 9.5 9.5 7.0 . . . 7.5 85... 
81Astone STAFF 6.0 6.0 6.0 5.8 6.0 6.0 . . 6.0 6.0... 
91Awest STAFF 5.5 6.5 5.5 4.5 4.5 . . . 6.5 6.5... 
101 BCELEBI STAFF 4.0 4.0 4.0 4.0 4.0 4.0 4.0 . 4.0 4.0... 
111 BCooke STAFF 4.0 4.0 8.0 8.0 80 . . . 404.0... 
12 1 B Jacobson STAFF 4.0 4.2 4.2 6.0 6.0 6.0 6.0 6.0 4.0 4.0... 
131 Bbrady STAFF 3.5 7.0 7.07.0 . . . . 10.010.0... 
141 Bcasey STAFF 5.0 4.5 4.5 5.5 5.5 5.5 . . 5.0 5.0... 
15 1B flick STAFF 5.0 10.0 10.0 10.010.010.0 . . 5.0 8.0... 
16 1B gillum STAFF 6.0 5.3 5.5 8.0 60 . . . 605.5... 
171 Bhague STAFF 7.0 7.0 7.0 9.0 9.0 9.0 . . 7.0 7.0... 
181 Bhsing STAFF 3.5 6.0 6.0 6.0 6.0 60 . . 5.0 5.0... 
191 Bromano STAFF 4.0 4.0 6.0 6.0 6.0 6.0 60 . 4.0 4.0... 
202 A Dennis STAFF 5.0 8.0 8.0 8.0 8.0 8.0 . . 5.0 7.0... 
21 2 A Lankhors STAFF 10.0 4.0 4.0 4.0 4.0 4.0 4.0 4.010.0 6.0. 
22 2 A Shaffer STAFF 5.0 9.015.015.0 7.0 . . . 5.0 9.0... 
232 ATURNER STAFF 4.0 8.0 8.0 8.0 8.0 8.0 8.0 . 6.0 8.0... 
242Aking STAFF 5.0 8.0 8.0 8.0 7.0 . . . 65 7.5... 
252A kopper STAFF 4.0 6.0 6.56.5 6.5 . . . 5.0 5.0... 
262 Amihlon STAFF 4.0 6.0 6.0 8.0 7.0 . . . 4.06.0... 
272 Aring STAFF 5.0 7.0 7.0 8.0 10.0 10.010.0 . 5.0 7.0... 
282 A staier STAFF 5.5 12.011.0 9.5 6.0 . . . 9.010.0... 
292 B Cameron STAFF 5.0 6.010.010.010.0 . . . 60 60... 


302 B Cepek STAFF 6.0 7.0 8.0 8.0 9.0 9.0 9.0 . 7.0 7.0... 
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312 B Chalfant STAFF 8.0 7.0 7.0 6.0 6.0 60 . . 8.0 8.0... 
32 2B Chaney STAFF 5.0 7.0 8.0 10.0 15.015.0 . . 7.0 7.0... 
332 B Earley STAFF 3.5 5.0 8.0 8.0 8.0 8.0 8.0 8.0 3.5 5.0... 
342 B Geberth STAFF 4.0 5.0 5.0 5.0 5.0 5.0 6.0 . 4.0 5.0... 
352 B Heaton STAFF 5.0 8.0 8.010.010.0100 . . 6.0 8.0. 
362 B James STAFF 4.0 5.0 5.0 5.0 5.0 5.0 6.0 6.0 5.0 5.0666 
372 Bcoats STAFF 5.0 6.0 6.0 8.0 8.0 8.0 8.0 . 5.0 5.0. 
382 B waller STAFF 5.0 5.0 5.0 5.0 7.0 10.0 20.0 20.0 5.0 5.0. a 
Repeated measures on process data. 14 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Class Level Information 


Class Levels Values 
GOALS yak 2, 


PROJECT 2 AB 


Number of observations in data set = 38 


Repeated measures on process data. 15 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 


Repeated Measures Level Information 


Dependent Variable 0D00 40D00 80D00 120D00 160D00 200D00 


Level of PERIOD 1 2 3 4 5 6 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD Effect 
H = Type III SS&CP Matrix for PERIOD E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 
Statistic Value F Num DF Den DF Pr > F 


Wilks' Lambda 0.51513667 5.8356 5 31 0.0007 
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Pillai's Trace 0.48486333 5.8356 5 31 0.0007 
Hotelling-Lawley Trace 0.94123242 5.8356 5 31 0.0007 
Roy's Greatest Root 0.94123242 5.8356 5 31 0.0007 


Manova Test Criteria and Exact F Statistics for the Hypothesis of no PERIOD*GOALS 
Effect 
H = Type III SS&CP Matrix for PERIOD*GOALS_ E = Error SS&CP Matrix 


S=1 M<=1.5 N=14.5 


Statistic Value F Num DF Den DF Pr>F 
Wilks' Lambda 0.95522269 0.2906 5 31 0.9145 
Pillai's Trace 0.04477731 0.2906 5 31 0.9145 


Hotelling-Lawley Trace 0.04687631 0.2906 5 31 0.9145 
Roy's Greatest Root 0.04687631 0.2906 5 31 0.9145 


Manova Test Criteria and Exact F Statistics for 
the Hypothesis of no PERIOD*PROJECT Effect 
H = Type III SS&CP Matrix for PERIOD*PROJECT E = Error SS&CP Matrix 


S=1 M=1.5 N=14.5 


Statistic Value F Num DF DenDF Pr > F 
Wilks' Lambda 0.80610911 1.4913 5 31 0.2211 
Pillai's Trace 0.19389089 1.4913 5 31 0.2211 


Hotelling-Lawley Trace 0.24052686 1.4913 5 31 0.2211 
Roy's Greatest Root 0.24052686 1.4913 5 31 0.2211 
Repeated measures on process data. 16 
09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Tests of Hypotheses for Between Subjects Effects 


Source DF Type III SS Mean Square F Value Pr > F 
GOALS 1 45.63157895 45.63157895 4.05 0.0519 
PROJECT 1 12.88507018 12.88507018 1.14 0.2921 
Error 35 394.13475439 11.26099298 

Repeated measures on process data. 7 
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09:37 Sunday, March 3, 1996 


General Linear Models Procedure 
Repeated Measures Analysis of Variance 
Univariate Tests of Hypotheses for Within Subject Effects 


Source: PERIOD 


Adj Pr > F 
DF Type III SS Mean Square F Value Pr >F G-G H-F 
5 131.39669591 26.27933918 14.42 0.0001 0.0001 0.0001 


Source: PERIOD*GOALS 


Adj Pr > F 
DF Type III SS Mean Square F Value Pr >F G-G H-F 


5 6.85157895 1.37031579 0.75 0.5856 0.4724 0.4858 
Source: PERIOD*PROJECT 


Adj Pr >F 
DF Type HI SS Mean Square F Value Pr>F G-G H-F 
5 6.97774854 1.39554971 0.77 0.5755 0.4660 0.4790 


Source: Error(PERIOD) 


DF Type III SS Mean Square 
175 318.86453216 1.82208304 


Greenhouse-Geisser Epsilon = 0.3907 
Huynh-Feldt Epsilon = 0.4372 


Repeated measures on process data. 


18 
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Variable N Mean Std Dev 


Minimum Maximum 
_0D00 9 4.9666667 0.9861541 3.5000000  6.5000000 
40D00 9 5.1888889 1.3905435 3.5000000  7.5000000 
_80D00 9 5.9666667 1.3865425 3.5000000 8.5000000 
_120D00 9 6.2444444 = 1.6432522 3.5000000  9.0000000 
_160D00 9 6.1888889 1.7702009  3.5000000 9.5000000 
_200D00 9 6.2000000 2.2961925 


3.0000000  10.0000000 


ne 


Variable N 
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Mean Std Dev Minimum Maximum 
_0D00 4.6000000 1.1498792 3.5000000 7.0000000 
_40D00 5.4000000 1.8973666 4.0000000 10.0000000 
_80D00 5.6500000 2.0554805 4.0000000 10.0000000 
_120D00 10 5.6000000 1.9544820 4.0000000 10.0000000 
_160D00 10 6.2200000 1.8635689  4.0000000 10.0000000 
_200D00 10 6.9500000 1.8020051  4.0000000 10.0000000 

wenn ne eee ene enone e- eee e--- 22 - == GOALS =2 PROJECT =A ---------------------------------- 

Variable N Mean Std Dev Minimum Maximum 

_0D00 9 §.2777778  1.8559215 4.0000000 10.0000000 

40D00 9 6.1666667 2.0310096  4.0000000 10.0000000 

_80D00 9 7.2777778 1.5634719  5.0000000 10.0000000 
120D00 9 = 7.5555556 =2.2422707 4.0000000 12.0000000 

_160D00 9 8.1666667 3.1819805  4.0000000 15.0000000 

200D00 9 = $.3333333 2.9261750  4.0000000 15.0000000 

2 nnn nnn ann anne nen e------------2--=- GOALS =2 PROJECT =B ---------------------------------- 

Variable N Mean Std Dev Minimum Maximum 

0D00 10 8 5.0500000 1.2572015 3.5000000  8.0000000 

40D00 10 5.6500000 1.4151953 3.5000000  8.0000000 

_80D00 10 6.1000000 1.2866839  5.0000000  8.0000000 

_120D00 10 6.1000000 1.1005049  5.0000000  8.0000000 

_160D00 10 7.0000000 1.6996732  5.0000000 10.0000000 
_200D00 10 7.5000000 2.1213203 5.0000000 10.0000000 


APPENDIX Q: PERFORMANCE DATA 
Performance data 1 
14:59 Tuesday, February 27, 1996 


OBS LNAME PROJECT GOALS ORDER FNCOST FNSKED- FNERR 
1 Asmus A 1 1 1082.44 360.0 1266.44 
2 johnson A 1 1 1496.63 312.0 1885.45 
3 jones A 1 1 1968.05 307.5 622.44 
4 leonard A 1 1 2040.21 365.5 559.06 
5 norris A 1 1 1756.22 251.0 1481.82 
6 gearhard A 1 2 1199.47 270.5 9781.81 
7 stone A 1 2 1630.60 310.0 738.44 
8 Stueve A 1 2 1142.96 269.0 7302.89 
9  ~=swest A 1 2 1348.78 271.0 2126.43 

10 Dennis A 2 1 1810.19 299.0 1097.82 
11 kopper A 2 1 1280.43 268.0 1932.55 
12  Lankhors A Z 1 1639.19 374.0 578.61 
13. Shaffer A 2 1 1972.70 258.5 771.77 
14 TURNER A 2 1 2061.62 327.0 873.75 
15 king A 2 2 1521.59 251.5 1184.90 
16 ~=mihlon A 2 2 1280.33 264.0 2573.47 
17 __—siring A 2 Z 2068.38 329.0 910.61 
18 staier A 2 Zz 1996.02 257.0 786.59 
19 brady B 1 1 1387.75 240.0 1334.88 
20 CELEBI B l 1 1274.16 352.0 1822.62 
21 flick B 1 1 2083.64 295.0 689.42 
22 hsing B 1 1 1349.10 289.5 1588.36 
23 romano B 1 1 1398.31 321.5 1251.58 
24 casey B 1 2 1381.59 312.0 1800.63 
25 Cooke B 1 iz 1167.53 259.0 2676.52 
26 = gillum B 1 Z 1328.09 259.0 1500.12 
27 hague B 1 2 1473.53 244.0 1290.76 
28 Jacobson B 1 2 1668.26 379.5 677.79 
29 Cepek B 2 1 2227.05 336.0 604.23 
30 §©coats B 2 1 1878.66 338.0 933.29 
31 Heaton B 2 1 2165.74 315.5 909.67 
32 James B Z I 2389.62 502.0 501.79 
33 _—-waliler B 2 1 2311.00 378.0 607.66 
34 Cameron B Z az 1700.44 274.5 1824.09 
35 Chalfant B Z 2 1848.91 307.5 570.79 
36 Chaney B 2 2 1936.47 285.5 955.76 
37 Earley B 2 2 2080.11 374.5 634.56 
38 Geberth B Z iz 1520.04 354.0 932.55 
Performance data Z 


14:59 Tuesday, 


February 27, 1996 
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Variable N Mean Std Dev Minimum Maximum 
FNCOST 9 1518.37 354.5411686 1082.44 2040.21 
FNSKED 9 = 301.8333333 40.6717039 251.0000000 365.5000000 
FNERR 9 2862.75 3323.77 559.0600000 9781.81 
FNERG 9 576.5511111 48.1981378 535.7200000 678.5300000 
FNERD 9 271.6488889 167.1901172 52.8800000 536.4400000 
FNERES 9 304.9011111 140.5700447 136.9500000 516.3700000 
FNPRDT 9 46.1355556 26.0814619  9.2900000 79.0600000 
FNQAMD 9 219.7011111 183.5586347 26.5200000 506.8600000 
FNTRMD 9 94,2944444 34.9914965 39.2100000 141.9100000 
FNRWMD 9 = 197.8455556 118.9816874 36.9800000 359.2900000 


Variable N Mean Std Dev Minimum Maximum 
FNCOST 9 1736.72 319.4066121 1280.33 2068.38 
FNSKED 9 292.0000000 42.8872067 251.5000000 374.0000000 
FNERR 9 1190.01 648.4037547 578.6100000 2573.47 
FNERG 9 604.9800000 52.1847159 550.1000000 690.5500000 
FNERD = 9 368.2533333 120.7299899 115.9300000 532.1700000 
FNERES 9 236.7255556 111.7545648 151.0600000 455.6100000 
FNPRDT 9 60.7177778 18.7304203 20.2800000 77.0600000 
FNQAMD 9 284.8488889 135.3733590 62.9400000 468.1000000 
FNTRMD 9 125.6377778 34.8176284 77.7900000 179.9500000 
FNRWMD- 9 271.3388889 87.3096888 87.0600000 339.3700000 


Variable N Mean Std Dev Minimum Maximum 
FNCOST 10 1451.20 257.4781858 1167.53 2083.64 
FNSKED 10 295.1500000 46.7006127 240.0000000 379.5000000 
FNERR 10 1463.27 581.0722069 677.7900000 2676.52 
FNERG-~ 10 633.2490000 62.8253792 535.0200000 747.9700000 
FNERD- 10 325.0920000 117.2672678 96.6400000 566.6200000 
FNERES) 10 308.1570000 102.0192853 181.3500000 551.1500000 
FNPRDT 10 51.0770000 15.8040255 14.9200000 75.7500000 
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FNQAMD 10 179.4270000 100.7888221 51.9100000 431.2800000 
FNTRMD 10 96.1850000 27.0112126 58.4800000 161.4300000 
FNRWMD- 10 218.9240000 89.2661783 71.2600000 418.7300000 


Variable N Mean Std Dev Minimum Maximum 
FNCOST 10 2005.80 277.9513111 1520.04 2389.62 
FNSKED 10 346.5500000 64.6204517 274.5000000 502.0000000 
FNERR-~ 10 847.4390000 386.1544804 501.7900000 1824.09 
FNERG 10 594.4380000 62.0690900 529.1400000 717.9000000 
FNERD 10 436.6400000 72.4674781 333.3700000 581.1000000 
FNERES) 10 = 157.7990000 36.4246688 124.2400000 251.2300000 
FNPRDT 10 73.2200000 6.6202853 57.0300000 80.9400000 
FNQAMD 10 502.2280000 237.0315975 213.9400000 875.8100000 
FNTRMD 10 136.3760000 30.4277831 81.7400000 189.1200000 
FNRWMD 10 318.7870000 31.6099137 245.5600000 357.8000000 
Performance data 3 
14:59 Tuesday, February 27, 1996 


General Linear Models Procedure 
Class Level Information 


Class Levels Values 
PROJECT 2 AB 
GOALS 2 Fig 


ORDER 2eeh2 


Number of observations in data set = 38 


Performance data 4 
14:59 Tuesday, February 27, 1996 


General Linear Models Procedure 


Dependent Variable: FNCOST 
Sum of Mean 


iS 


Source DF Squares Square F Value Pr > F 
Model 4 2277775.07 569443.77 7.00 0.0003 
Error 33. 2684989.92 $1363.33 


Corrected Total 37  4962765.00 


R-Square C.V. Root MSE FNCOST Mean 

0.458973 16.97186 285.243 1680.68 
Source DF TypeIlSS Mean Square F Value Pr > F 
PROJECT l 96554.96  96554.96 1.19 0.2839 
GOALS 1 1484675.65 1484675.65 18.25 0.0002 
ORDER 1 428737.80 428737.80 5.27 0.0282 
PROJECT*GOALS 1 267806.67 267806.67 3.29 0.0787 
Source DF TypelIII SS Mean Square F Value Pr >F 
PROJECT 1 120152.18 120152.18 1.48 0.2329 
GOALS 1 = 1415022.07 1415022.07 17.39 0.0002 
ORDER 1 428737.80 428737.80 5.27 0.0282 
PROJECT*GOALS 1 267806.67 267806.67 3.29 0.0787 

Performance data 5 


14:59 Tuesday, February 27, 1996 
General Linear Models Procedure 


Dependent Variable: FNSKED 


Sum of Mean 
Source DF Squares Square F Value Pr > F 
Model 4 29400.5405 7350.1351 3.24 0.0239 
Error 33 74829.7029 2267.5668 


Corrected Total 37 =104230.2434 
R-Square C.V. Root MSE FNSKED Mean 


0.282073 15.38512 47.6190 309.513 
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Source DF TypeISS Mean Square F Value Pr > F 


PROJECT 1 5426.5684  5426.5684 2.39 0.1314 
GOALS 1 4764.4803 4764.4803 2.10 0.1566 
ORDER 1 10329.0471 10329.0471 4.56 0.0403 
PROJECT*#GOALS 1 8880.4447 8880.4447 3.92 0.0562 
Source DF Type III SS Mean Square F Value Pr > F 
PROJECT 1 6272.2748 6272.2748 2.77 0.1058 
GOALS 1 4092.1289 4092.1289 1.80 0.1883 
ORDER 1 10329.0471 10329.0471 4.56 0.0403 
PROJECT*#GOALS 1 8880.4447 8880.4447 3.92 0.0562 
Performance data 6 


14:59 Tuesday, February 27, 1996 
General Linear Models Procedure 


Dependent Variable: FNERR 


Sum of Mean 

Source DF Squares Square F Value Pr > F 
Model 4 33357863.8  8339466.0 3.26 0.0233 
Error 33 84440905.2 2558815.3 
Corrected Total 37 117798769.0 

R-Square C.V. Root MSE FNERR Mean 

0.283177 102.0208 1599.63 1567.95 
Source DF TypeISS Mean Square F Value Pr > F 
PROJECT 1 7187571.8 7187571.8 2.81 0.1032 
GOALS 1 11841878.1 11841878.1 4.63 0.0389 
ORDER 1 11682715.6 11682715.6 4.57 0.0401 
PROJECT*GOALS 1 2645698.3 2645698.3 1.03 0.3166 
Source DF Type III SS Mean Square F Value Pr> F 
PROJECT 1 8218043.7 8218043.7 3.21 0.0823 
GOALS 1 12404779.3  12404779.3 4.85 0.0348 
ORDER } 11682715.6 11682715.6 4.57 0.0401 
PROJECT*GOALS 1 2645698.3 2645698.3 1.03 0.3166 
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APPENDIX R. SAMPLE CAPTURE. DAT 


NAME SMC# A2140R1 70 
NAME SMC# A2140R2 29 
NAME SMC# A2140R3 54 
NAME SMC# A2140G4 33 
NAME SMC A2140G8 13 
NAME SMC# A2140R1 280 
NAME SMC# A2140GS5 12 
NAME SMC# A21 40 R1 317 
NAME SMC# A2180R1 51 
NAME SMC# A2180R2 23 
NAME SMC# A2180R3 55 
NAME SMC# A2180G4 22 
NAME SMC# A2180G5 10 
NAME SMC#4 A2180G8 13 
NAME SMC# A211 80 R1 332 
NAME SMC# A 21 80 RI 320 
NAME SMC# A21120R1 36 
NAME SMC# A 21120 R2 29 
NAME SMC# A21120R3 60 
NAME SMC# A21120 G8 15 
NAME SMC#A21120G5 5 
NAME SMC# A 21120 G4 31 
NAME SMC# A21120R1 218 
NAME SMC# A21160R1 15 
NAME SMC# A 21 160 G6 10 
NAME SMC# A21160R3 4 
NAME SMC# A21160R2 20 
NAME SMC# A 21160 R3 25 
NAME SMC# A21160 G6 I1 
NAME SMC# A21160R1 93 
NAME SMC# A 21200 RI 24 
NAME SMC# A 21200 R2 25 
NAME SMC# A 21200 R3 20 
NAME SMC# A 21200 G6 45 
NAME SMC#A21200GS5S 6 
NAME SMC# A21 200 R1 124 
NAME SMC# A21240R1 18 
NAME SMC# A2 1240 R2 20 
NAME SMC# A21240R3 43 
NAME SMC# A 21240 G4 16 
NAME SMC# A 21240 G6 90 
NAME SMC# A211 240 RI 203 
NAME SMC# A21280R1 30 
NAME SMC# A 21 280 R2 31 
NAME SMC# A 21280 R314 
NAME SMC# A 2 1 280 G6 14 
NAME SMC# A 2 1 280 G4 13 
NAME SMC# A 2 1 280 R1 278 
NAME SMC# A21320R1 26 
NAME SMC# A21320 G5 7 
NAME SMC# A21320R3 8 
NAME SMC# A21320 RI 13 


a 
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APPENDIX S. SAS PROGRAM FILES 


PERFORMANCE.SAS: 


title "Performance data " ; 
options linesize=75; 
options pagesize=200; 
data one; 


infile "/h/joshua_u1/tmroylan/thesis/Timdata/performance.dat"; 
input Iname $ smc $ project $ goals $ order $ fncost fnsked fnerr 
fnerg fnerd fneres f{nprdt fnqamd fntrmd fnrwmd; 


/[% 

if (project ='B') then delete; 

if (project='A') then delete; 

if (project='A') then initcost=944; 

if (project='A') then initsked=272; 

if (project='B') then initcost = 1960; 
if (project='B') then initsked=272; 
costdev = abs(fncost-initcost); 
pcostdev = abs(fncost-initcost)/fncost; 
skeddev = abs(fnsked-initsked); 


pskeddev = abs(fnsked-initsked)/fnsked; 
7 


if (project='C') then delete; 


proc sort; 
by project goals order ; 


proc print; var Iname project goals order fncost fnsked fnerr; 


proc means; by project goals ; 


io 


proc gim; 
class project goals order ; 
model fncost fnsked fnerr /* fnerg fnerd fneres fnprdt 
fnqamd fntrmd fnrwmd fncost */= project goals order project*goals ; 


run; 
PROCESS.SAS 


libname dataname "/h/joshua_ul/tmroylan/thesis/Timdata"; 

options pagesize=200; 

title "Repeated measures on process data. " ; 

data dataname.dat (keep= Iname smc_ project goals order time 
qc); 

infile "/h/joshua_u1/tmroylan/thesis/Timdata/process.dat"; 

input Iname $ smc $ project $ goals $ order $ time $ varl-var27 prod 

Staff qc cost duration ; 


if (project='C') then delete; 


proc sort data=dataname.dat out=dataname.sort; 
by goals project Iname time ; 


/* 

proc means; by project goals Iname time ; 
var Staff qc cost duration; 

as 


proc transpose data=dataname.sort out=dataname.trans 
/* (rename=(_0.00=yl 40.00=y2 80.00=y3 120.00=y4 _ 160.00=y5 
_200.00=y6 
_240.00=y7))*/; 
by goals project Iname; 
id time; 


proc print; 


proc gim data=dataname.trans; 
class goals project ; 
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model 0D00 40D00 80D00 120D00 160D00 200D00 
= goals project/nouni; 
repeated period /*polynomial /short summary*/; 
proc means; 
var 0D00 40D00 80D00 120D00 160D00 200D00; 
by goals project; 
run; 


CAPTURE.SAS 


libname dataname "/h/joshua_u1/tmroylan/thesis/Timdata"; 

options pagesize= 200; 

title "Repeated measures on capture data. " ; 

data dataname.dat (keep= Iname smc _ project goals order time 

g4time); 

infile "/h/joshua_u1/tmroylan/thesis/Timdata/capture.dat"; 

input Iname $ smc §$ project $ goals $ order $ time $ rlfreq rltime r2freq r2time 
r3freq r3time r4freq r4time glfreq gltime g2freq g2time g3freq g3time 
e4freq g4time; 


if (project='C') then delete; 


proc sort data=dataname.dat out=dataname.sort; 
by goals project Iname time ; 


proc transpose data=dataname.sort out=dataname.trans 
/* (rename=(_0.00=yl1 40.00=y2 80.00=y3 120.00=y4 160.00=y5 
_200.00= y6 
_240.00=y7))*/; 

by goals project Iname; 

id time; 
proc print; 
proc gim data=dataname.trans; 

class goals project ; 


model 0 40 80 120 160 200 
= goals project/nouni; 


sol 


repeated period /*polynomial /short summary*/; 
proc means; 
var 0 40 80 120 160 200; 
by goals project; 
run; 


[pz 
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